-- Logs begin at Sat 2022-07-30 04:09:50 UTC, end at Sat 2022-07-30 05:16:06 UTC. -- Jul 30 04:49:26.453000 dv-cinder-851279-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 30 04:49:26.462006 dv-cinder-851279-3-iscsi devstack@n-api.service[103187]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 30 04:49:26.464017 dv-cinder-851279-3-iscsi devstack@n-api.service[103187]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Jul 30 04:49:26 2022] *** Jul 30 04:49:26.464017 dv-cinder-851279-3-iscsi devstack@n-api.service[103187]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 30 04:49:26.464017 dv-cinder-851279-3-iscsi devstack@n-api.service[103187]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 30 04:49:26.464017 dv-cinder-851279-3-iscsi devstack@n-api.service[103187]: nodename: dv-cinder-851279-3-iscsi Jul 30 04:49:26.464017 dv-cinder-851279-3-iscsi devstack@n-api.service[103187]: machine: x86_64 Jul 30 04:49:26.464017 dv-cinder-851279-3-iscsi devstack@n-api.service[103187]: clock source: unix Jul 30 04:49:26.464017 dv-cinder-851279-3-iscsi devstack@n-api.service[103187]: pcre jit disabled Jul 30 04:49:26.464017 dv-cinder-851279-3-iscsi devstack@n-api.service[103187]: detected number of CPU cores: 4 Jul 30 04:49:26.464017 dv-cinder-851279-3-iscsi devstack@n-api.service[103187]: current working directory: / Jul 30 04:49:26.464017 dv-cinder-851279-3-iscsi devstack@n-api.service[103187]: detected binary path: /usr/bin/uwsgi-core Jul 30 04:49:26.464017 dv-cinder-851279-3-iscsi devstack@n-api.service[103187]: your processes number limit is 47680 Jul 30 04:49:26.464017 dv-cinder-851279-3-iscsi devstack@n-api.service[103187]: your memory page size is 4096 bytes Jul 30 04:49:26.464017 dv-cinder-851279-3-iscsi devstack@n-api.service[103187]: detected max file descriptor number: 2048 Jul 30 04:49:26.464017 dv-cinder-851279-3-iscsi devstack@n-api.service[103187]: lock engine: pthread robust mutexes Jul 30 04:49:26.464992 dv-cinder-851279-3-iscsi devstack@n-api.service[103187]: thunder lock: enabled Jul 30 04:49:26.464992 dv-cinder-851279-3-iscsi devstack@n-api.service[103187]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 30 04:49:26.464992 dv-cinder-851279-3-iscsi devstack@n-api.service[103187]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 30 04:49:26.502832 dv-cinder-851279-3-iscsi devstack@n-api.service[103187]: Python main interpreter initialized at 0x5603a220b9c0 Jul 30 04:49:26.502832 dv-cinder-851279-3-iscsi devstack@n-api.service[103187]: python threads support enabled Jul 30 04:49:26.502832 dv-cinder-851279-3-iscsi devstack@n-api.service[103187]: your server socket listen backlog is limited to 100 connections Jul 30 04:49:26.502832 dv-cinder-851279-3-iscsi devstack@n-api.service[103187]: your mercy for graceful operations on workers is 90 seconds Jul 30 04:49:26.503161 dv-cinder-851279-3-iscsi devstack@n-api.service[103187]: mapped 403077 bytes (393 KB) for 2 cores Jul 30 04:49:26.503236 dv-cinder-851279-3-iscsi devstack@n-api.service[103187]: *** Operational MODE: preforking *** Jul 30 04:49:26.503487 dv-cinder-851279-3-iscsi devstack@n-api.service[103187]: *** uWSGI is running in multiple interpreter mode *** Jul 30 04:49:26.503487 dv-cinder-851279-3-iscsi devstack@n-api.service[103187]: spawned uWSGI master process (pid: 103187) Jul 30 04:49:26.503666 dv-cinder-851279-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 30 04:49:26.504322 dv-cinder-851279-3-iscsi devstack@n-api.service[103187]: spawned uWSGI worker 1 (pid: 103188, cores: 1) Jul 30 04:49:26.506502 dv-cinder-851279-3-iscsi devstack@n-api.service[103187]: spawned uWSGI worker 2 (pid: 103189, cores: 1) Jul 30 04:49:26.506502 dv-cinder-851279-3-iscsi devstack@n-api.service[103187]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 30 04:49:27.158101 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 30 04:49:27.178826 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 30 04:49:28.233390 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 30 04:49:28.233390 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: from cryptography.utils import int_from_bytes Jul 30 04:49:28.233986 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 30 04:49:28.233986 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: from cryptography.utils import int_from_bytes Jul 30 04:49:28.238974 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 30 04:49:28.238974 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: from cryptography.utils import int_from_bytes Jul 30 04:49:28.239417 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 30 04:49:28.239417 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: from cryptography.utils import int_from_bytes Jul 30 04:49:30.704084 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 30 04:49:30.704627 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 30 04:49:30.704845 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 30 04:49:30.705200 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 30 04:49:30.705446 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 30 04:49:30.705827 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.706141 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.706477 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.706785 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.707102 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.707220 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 30 04:49:30.707594 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.707679 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 30 04:49:30.707767 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.707915 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 30 04:49:30.708043 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.708280 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 30 04:49:30.708396 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.708535 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.708667 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 30 04:49:30.708919 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.709233 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.709325 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-851279-3-iscsi {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.709551 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.709657 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.709842 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.709944 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.710141 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.710229 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.710472 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.710576 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.710768 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.710868 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.711080 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.711175 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.711386 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.711479 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.711725 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.711874 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.711977 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.712400 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.712515 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.712631 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-851279-3-iscsi {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.712744 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.712882 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.712996 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.713181 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.713296 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.713487 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.713577 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.713784 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.713873 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.714085 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.714179 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.714380 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.714504 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.714714 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.714800 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.715014 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.715209 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.715403 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-851279-3-iscsi {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.715515 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.715716 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.715813 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.716018 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.716105 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.716323 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.716412 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.716716 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.716812 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.717014 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.717107 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.717313 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.717399 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.717612 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.717709 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.717923 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.718008 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.718218 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.718337 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.718565 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.718724 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-851279-3-iscsi {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.718896 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.718981 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.719171 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.719268 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.719480 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.719568 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.719771 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.719942 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.720068 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.720248 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.720366 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.720554 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.720673 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.720872 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.721012 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.721193 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.721291 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.721478 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.721573 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.721786 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.721883 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.722082 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.722170 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.722390 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.722523 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.722731 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.722831 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.722976 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.723064 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.723218 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.723313 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.723524 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.723612 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.723834 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.723936 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.724131 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.724742 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.724986 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.725134 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.725288 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.725422 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.725564 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.725764 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.725852 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.726089 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.726178 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.726413 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.726567 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.726735 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.726822 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.726994 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.727094 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.727243 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.727332 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.727561 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.727648 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.727878 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.727978 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.728189 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.728277 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.728497 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.728619 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.728803 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.728925 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.729098 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.729184 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.729397 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.729484 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.729697 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.729786 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.729998 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.730093 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.730300 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.730387 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.730636 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.730725 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.730933 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.731026 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.731229 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.731317 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.731526 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.731614 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.731834 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.731921 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.732156 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.732243 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.732452 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.732541 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.732696 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.732784 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.732986 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.733087 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.733297 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.733392 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.733587 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.733690 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.733882 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.733978 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.734174 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.734261 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.734568 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.734669 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.734764 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.734855 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.735059 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.735148 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.735352 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.735439 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.735647 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.735744 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.735949 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.736038 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.736242 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.736377 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.736534 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.736624 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.736828 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.736916 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.737122 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.737209 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.737413 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.737502 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.737710 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.737798 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.738011 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.738108 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.738303 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.738391 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.738621 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.738727 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.738962 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.739064 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.739198 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.739287 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.739495 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.739590 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.739787 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.740457 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.740674 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.740817 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.740980 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.741145 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.741282 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.741445 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.741583 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.741742 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.741897 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.742050 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.742211 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.742356 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.742533 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.742655 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.742833 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.742965 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.743135 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.743237 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.743435 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.743532 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.743748 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.743843 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.744048 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.744145 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.744348 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.744435 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.744664 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.744751 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.744952 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.745049 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.745243 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.745339 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.745534 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.745621 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.745830 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.745994 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.746120 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.746207 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.746407 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.746544 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.746731 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.746837 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.747033 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.747129 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.747323 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.747410 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.747617 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.747713 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.747908 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.748003 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.748209 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.748303 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.748507 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.748596 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.748804 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.748897 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.749107 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.749227 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.749402 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.749493 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.749698 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.749785 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.749989 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.750077 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.750301 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.750398 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.750639 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.750727 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.750940 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.751039 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.751239 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.751333 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.751536 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.751623 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.751845 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.751939 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:49:30.752149 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.752235 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.752459 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.752558 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.752765 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.752863 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.753082 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.753170 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.753389 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.753475 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.753692 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.753783 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.754000 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.754087 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.754300 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.754393 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.754627 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.754740 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.754945 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.755041 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.755249 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.755398 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.755597 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.755739 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.755901 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.756095 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.756391 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.756543 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.756713 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.756804 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.757025 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.757112 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.757336 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.757425 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.757639 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.757736 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.757939 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.758027 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.758237 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.758333 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.758575 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.758688 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.758901 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.758988 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.759203 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.759299 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.759510 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.759598 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.759810 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.759905 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.760112 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.760219 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.760412 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.760507 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.760713 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.760806 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.761015 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.761111 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.761341 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.761431 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.761647 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.761743 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.762246 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.769658 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.769658 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.769869 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.769957 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.770049 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.770133 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.770223 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.770797 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.770887 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.770969 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.771050 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.771163 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.771264 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.771337 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.771403 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.771469 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.771534 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.771614 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.771682 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.771747 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.771812 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.771878 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.771944 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.772018 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.772099 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.772178 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.772267 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.772348 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.772433 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.772531 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.772621 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.772698 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.772773 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.772853 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.772933 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.773021 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.773101 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.773180 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.773259 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.773346 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.773506 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.773590 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.773676 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.773765 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.773846 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.773926 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.774018 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.774106 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.774186 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.774266 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.774345 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.774424 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.774424 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.774608 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.774689 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.774768 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.774847 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.774927 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.775018 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.775018 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.775170 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.775258 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.775338 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.775338 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.775500 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.775581 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.775660 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.775739 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.775818 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.775909 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.775996 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.776077 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.776157 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.776236 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.776321 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.776414 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.776542 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.776630 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.776712 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.776791 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.776870 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.776959 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.777041 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.777120 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.777198 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.777277 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.777364 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.777445 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.777524 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.777602 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.777694 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.777694 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.777857 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.777945 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.778025 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.778112 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.778193 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.778279 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.778369 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.778467 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.778551 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.778630 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.778709 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.778788 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.778879 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.778976 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.779057 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.779140 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.779221 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.779356 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.779482 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.779567 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.779654 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.779736 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.779815 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.779904 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.779985 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.780066 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.780145 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.780224 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.780303 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.780440 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.780564 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.780749 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.780865 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.781063 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.781151 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.781367 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.781455 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.781672 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.781760 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.781974 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.782075 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.782276 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.782364 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.782601 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.782692 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.782905 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.783063 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.783202 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.783337 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.783472 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.783607 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.783798 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.783956 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.784095 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.784230 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.784401 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.784538 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.784705 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.784852 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.785016 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.785175 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.785314 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.785450 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.785593 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.785727 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.785918 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.786056 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.786226 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.786364 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.786558 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.787204 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.787379 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.787470 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.787702 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.787841 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.787988 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.788135 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.788292 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.788442 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.788607 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.788745 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.788919 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.789060 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.789218 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.789354 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.789528 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.789620 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.789829 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.789925 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.790126 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.790225 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.790425 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.790574 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.790763 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.790852 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.791067 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.791166 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.791374 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.791472 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.791668 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.791756 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.791971 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.792065 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.792287 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.792386 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.792589 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.792677 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.792895 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.792990 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.793196 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.793292 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.793499 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.793585 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.793797 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.793883 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.794097 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.794185 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.794396 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.794505 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.794715 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.794803 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.795013 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.795136 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.795315 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.795410 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.795618 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.795706 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.795915 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.796010 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.796213 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.796300 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.796507 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.796594 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.796810 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.796900 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.797109 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.797205 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.797403 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.797501 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.797697 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.797786 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.797998 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.798086 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.798309 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.798404 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.798632 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.798722 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.798938 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.799026 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.799239 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.799345 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.799535 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.799642 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.799830 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.799958 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.800142 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.800263 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.800441 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.800568 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.800735 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.800868 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.801029 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.801176 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.801322 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.801482 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.801654 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.801782 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.801955 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.802079 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.802252 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.802969 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.803177 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.803269 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.803499 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.803621 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.803800 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.803899 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.804109 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.804197 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.804413 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.804500 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.804715 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.804801 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.805030 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.805126 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.805330 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.805417 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.805631 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.805718 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.805928 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.806023 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.806227 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.806319 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.806550 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.806652 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.806856 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.806958 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.807170 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.807255 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.807470 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.807554 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.807773 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.807872 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.808073 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.808158 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.808368 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.808452 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.808674 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.808767 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.809034 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.809125 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.809352 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.809680 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.809785 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.809961 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.810057 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.810262 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.810348 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.810591 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.810696 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.810898 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.810985 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.811203 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.811289 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.811521 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.811621 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.811825 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.811911 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.812130 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.812216 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.812432 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.812526 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.812730 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.812815 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.813025 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.813124 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.813324 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.813422 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.813623 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.813878 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.813974 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.814203 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.814288 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.814521 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.814611 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.814826 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.814911 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.815121 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.815207 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.815416 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.815503 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.815716 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.815814 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.816012 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.816098 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.816317 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.816404 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.816611 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.816714 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.816913 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.817006 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.817206 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.817306 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.817520 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.817606 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.817818 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.817910 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.818143 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.818401 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.818556 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.818640 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.818760 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.818847 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.819067 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.819162 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.819368 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.819465 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.819679 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.819765 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.819986 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.820077 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.820269 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.820384 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.820576 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.820683 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.820877 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.820966 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.821181 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.821267 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.821481 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.821568 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.821800 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.821925 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.822102 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.822187 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.822401 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.822536 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.822725 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.822810 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.823020 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.823113 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.823392 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.823499 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.823623 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.823709 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.823923 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.824009 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.824223 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.824318 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.824516 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.824602 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.824814 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.824899 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.825107 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.825201 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.825415 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.825501 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.825722 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.825807 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.826017 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.826104 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.826310 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.826395 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.826642 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.826730 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.826945 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.827071 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.827239 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.827346 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.827538 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.827627 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.827830 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.827919 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.828133 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.828220 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.828426 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.828512 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.828721 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.828817 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.829012 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.829100 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.829307 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.829403 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.829603 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.829690 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.829897 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.829986 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.830192 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.830289 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.830515 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.830620 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.830810 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.830897 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.831104 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.831201 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.831397 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.831483 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.831687 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.831780 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.831980 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.832077 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.832277 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.832365 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.832574 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.832667 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.832872 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.832961 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.833162 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.833249 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.833463 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.833559 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.833785 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.833911 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.834079 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.834222 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.834431 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.834586 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.834720 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.834853 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.835018 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.835152 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.835315 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.835448 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.835617 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.835749 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.835915 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.836043 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.836213 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.836339 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.836516 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.836652 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.836835 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.836952 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.837147 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.837268 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.837446 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.837541 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.837749 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.837855 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.838046 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.838189 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.838326 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.838491 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.838647 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.838777 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.838966 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.839189 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.839416 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.839536 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.839714 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.839866 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.840063 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.840212 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.840348 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.840503 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.840754 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.840841 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.841087 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.841314 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.841401 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.841678 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.841910 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.841997 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.842250 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.842533 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.842627 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.842880 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.843120 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.843214 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.843481 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.843686 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.843784 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.844094 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.844262 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.844388 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.844687 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.844906 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.845001 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.845272 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.845481 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.845576 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.845862 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.846136 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.846230 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.846464 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.846753 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.846861 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.847077 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.847334 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.847438 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.847649 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.847944 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.848115 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.848260 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.848519 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.848657 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.848834 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.849106 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.849806 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.849983 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.850223 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.850333 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.850644 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.850830 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.850947 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.851243 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.851414 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.851665 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.851971 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.852137 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.852274 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.852572 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.852666 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.852874 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.853136 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.853234 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.853941 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.854050 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.854134 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.854214 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.854294 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.854492 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.854587 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.854776 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.854865 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.855077 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.855180 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.855378 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.855499 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.855675 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.855832 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.855969 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.856144 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.856274 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.856457 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.856588 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.856772 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.856881 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.857084 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.857220 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.857397 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.857487 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.857706 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.857802 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.858018 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.858107 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.858328 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.858416 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.858662 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.858765 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.858974 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.859062 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.859290 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.859379 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.859594 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.859718 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.859901 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.860024 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.860208 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.860327 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.860512 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.860670 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.860835 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.860925 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.861142 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.861241 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.861445 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.861547 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.861752 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.861840 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.862052 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.862141 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.862360 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.862472 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.862689 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.862780 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.863009 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.863103 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.863314 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.863404 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.863609 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.863698 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.863923 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.864013 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.864239 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.864329 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.864547 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.864636 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.864920 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.865508 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.865756 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.865964 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.866063 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.866215 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.866482 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.866589 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.866796 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.866889 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.867104 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.867193 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.867412 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.867556 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.867715 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.867804 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.868014 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.868112 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.868312 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.868402 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.868611 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.868710 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.868913 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.869002 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.869216 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.869310 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.869514 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.869610 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.869816 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.869920 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.870117 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.870207 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.870415 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.870535 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.870733 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.870852 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.871049 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.871160 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.871347 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.871444 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.871664 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.871861 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.871971 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.872168 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.872286 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.872475 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.872601 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.872793 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.872890 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.873109 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.873206 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.873428 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.873516 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.873729 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.873825 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.874040 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.874137 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.874333 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.874420 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.874678 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.874767 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.874973 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.875062 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.875284 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.875372 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.875591 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.875678 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.875892 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.875981 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.876210 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.876297 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.876524 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.876723 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.876827 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.876911 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.877135 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.877223 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.877445 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.877535 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.877762 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.877855 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.878059 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.878147 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.878353 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.878471 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.878680 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.878782 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.878976 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.879064 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.879272 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.879370 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.879567 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.879656 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.879867 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.879955 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.880160 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.880258 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.880476 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.880577 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.880800 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.880938 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.881095 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.881321 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.881413 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.881634 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.881737 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.881942 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.882041 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.882246 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.882343 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.882570 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.882662 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.882866 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.882969 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.883174 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.883263 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.883480 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.883567 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.883790 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.883888 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.884095 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.884191 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.884407 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.884498 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.884706 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.884808 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.885009 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.885096 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.885314 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.885401 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.885614 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.885704 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.885916 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.886005 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.886214 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.886303 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.886540 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.886631 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.886848 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.886936 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.887410 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.887517 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.887716 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.887806 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.888014 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.888115 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.888319 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.888448 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.888624 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.888715 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.888930 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.889019 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.889288 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.889444 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.889602 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.889762 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.889924 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.890067 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.890226 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.890372 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.890578 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.890690 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.890850 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.890987 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.891152 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.891280 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.891583 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.891671 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.891885 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.891973 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.892186 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.892321 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.892484 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.892572 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.892790 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.892887 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.893087 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.893176 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.893405 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.893493 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.893703 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.893790 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.894022 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.894112 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.894324 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.894420 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.894647 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.894736 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.894948 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.895039 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.895245 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.895334 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.895585 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.895690 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.895880 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.895968 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.896713 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.896811 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.897021 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.897159 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.897367 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.897480 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.897671 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.897806 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.897972 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.898113 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.898279 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.898457 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.898596 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.898768 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.898899 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.899081 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.899200 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.899392 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.899506 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.899710 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.899876 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.900019 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.900110 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.900332 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.900420 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.900719 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.900821 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.901022 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.901109 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.901327 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.901417 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.901634 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.901724 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.901942 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.902143 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.902481 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.902573 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.902795 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.902886 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.903106 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.903201 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.903417 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.903505 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.903722 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.903810 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.904028 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.904117 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.904337 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.904438 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.904631 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.904719 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.904925 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.905020 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.905225 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.905328 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.905523 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.905613 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.905817 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.905906 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.906135 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.906236 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.906454 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.906545 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.906750 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.906839 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.907059 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.907229 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.907357 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.907446 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.907695 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.907880 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.908024 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.908224 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.908346 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.908534 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.908660 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.908854 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.908953 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.909174 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.909263 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.909483 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.909572 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.909783 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.909873 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.910100 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.910197 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.910400 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.910541 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.910723 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.910814 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.911030 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.911165 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.911334 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.911423 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.911629 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.911737 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.912477 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.912586 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.912793 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.912956 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.913096 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.913284 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.913394 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.913619 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.913715 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.913937 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.914035 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.914249 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.914337 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.914588 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.914681 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.914889 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.914979 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.915185 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.915404 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.915501 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.915715 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.915813 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.916043 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.916131 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.916344 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.916439 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.916637 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.916799 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.916942 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.917032 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.917237 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.917325 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.917539 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.917631 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.917835 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.917924 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.918137 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.918271 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.918474 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.918567 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.918751 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.918841 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.919049 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.919137 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.919368 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.919457 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.919678 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.919767 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.919971 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.920058 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.920278 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.920376 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.920578 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.920667 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.920890 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.921103 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.921193 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.921446 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.921543 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.921757 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.921846 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.922077 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.922175 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.922399 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.922714 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.922804 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.923023 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.923124 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.923338 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.923428 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.923639 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.923727 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.923940 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.924038 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.924250 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.924339 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.924547 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.924634 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.924845 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.924934 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.925141 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.925227 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.925447 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.925544 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.925748 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.925837 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.926044 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.926140 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.926348 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.926456 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.926671 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.926763 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.926971 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.927073 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.927276 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.927430 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.927622 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.927810 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.928087 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.928223 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.928403 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.928507 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.928711 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.928827 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.929004 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.929098 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.929304 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.929401 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.929733 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.929831 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.929914 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.929996 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.930223 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.930321 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.930562 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.930657 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.930862 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.931007 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.931169 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.931258 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.931468 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.931564 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.931765 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.931854 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.932067 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.932164 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.932367 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.932464 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.932667 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.932756 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.932972 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.933060 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.933285 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.933373 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.933584 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.933693 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.933874 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.933963 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.934189 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.934276 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.934519 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.934631 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.934860 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.934950 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.935170 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.935260 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.935478 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.935705 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.935795 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.936041 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.936130 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.936360 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.936448 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.936683 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.936773 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.936983 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.937072 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.937301 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.937397 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.937608 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.937697 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.937913 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.938003 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.938230 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.938326 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.938552 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.938657 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.938850 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.938985 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.939146 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.939244 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.939447 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.939536 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.939757 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.939844 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.940055 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.940144 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.940351 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.940439 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.940644 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.940733 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.940944 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.941077 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.941238 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.941328 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.941530 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.941619 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.941902 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.942028 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.942137 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.942229 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.942388 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.942492 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.942706 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.942797 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.943031 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.943124 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.943383 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.943615 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.943702 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.943782 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.943994 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.944084 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.944309 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.944407 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.944609 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.944696 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.944904 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.945000 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.945199 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.945298 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.945492 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.945580 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.945786 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.945883 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.946082 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.946183 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.946404 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.946565 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.946729 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.946831 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.947043 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.947132 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.947358 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.947448 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.947658 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.947746 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.947970 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.948066 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.948269 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.948398 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.948580 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.948669 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.948891 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.948981 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.949196 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.949293 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.949497 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.949600 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.949821 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.949910 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.950122 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.950212 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.950425 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.950546 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.950749 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.950839 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.951051 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.951186 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.951355 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.951454 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.951658 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.951756 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.951953 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.952041 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.952260 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.952351 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.952565 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.952654 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.952869 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.952957 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.953169 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.953258 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.953468 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.953564 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.953773 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.953868 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.954068 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.954205 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.954367 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.954502 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.954691 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.954795 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.954990 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.955078 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.955290 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.955384 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.955587 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.955684 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.955886 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.955973 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.956180 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.956267 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.956481 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.956581 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.956781 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.956870 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.957080 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.957168 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.957383 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.957481 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.957683 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.957778 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.957980 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.958069 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.958278 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.958368 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.959150 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.959254 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.959572 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.959662 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.959797 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.959888 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.960102 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.960191 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.960436 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.960524 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.960755 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.960851 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.961060 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.961150 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.961364 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.961461 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.961657 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.961748 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.961893 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 30 04:49:30.961989 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.962282 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.962625 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.962933 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.963262 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.963569 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.963876 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.964185 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.964493 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.964879 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.965190 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.965515 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.965838 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.966142 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.966485 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.966804 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.967123 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.967437 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.967745 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.968073 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.968382 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.968692 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.968999 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.969307 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.969615 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.969930 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.970237 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.970572 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.970885 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.971197 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.971522 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.971845 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.972152 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.972475 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.972801 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.973146 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.973457 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.973797 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.974124 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.975054 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.975363 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.975668 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:49:30.975910 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 30 04:49:31.115507 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: INFO dbcounter [None req-b41052cd-b497-4e14-b64d-2c50f13a7532 None None] Registered counter for database nova_api Jul 30 04:49:31.128910 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: INFO dbcounter [None req-cb1f6919-ef78-4fbe-a1f2-f70bc1d75cb9 None None] Registered counter for database nova_api Jul 30 04:49:31.135879 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG oslo_db.sqlalchemy.engines [None req-b41052cd-b497-4e14-b64d-2c50f13a7532 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103189) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 30 04:49:31.142791 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG dbcounter [-] [103189] Writer thread running {{(pid=103189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 30 04:49:31.149589 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG oslo_db.sqlalchemy.engines [None req-cb1f6919-ef78-4fbe-a1f2-f70bc1d75cb9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103188) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 30 04:49:31.156099 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG dbcounter [-] [103188] Writer thread running {{(pid=103188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 30 04:49:31.199866 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.context [None req-b41052cd-b497-4e14-b64d-2c50f13a7532 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),25ab7be4-4766-4eb8-ab18-1f848f2f4df6(cell1) {{(pid=103189) load_cells /opt/stack/nova/nova/context.py:464}} Jul 30 04:49:31.203837 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG oslo_concurrency.lockutils [None req-b41052cd-b497-4e14-b64d-2c50f13a7532 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:49:31.205445 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG oslo_concurrency.lockutils [None req-b41052cd-b497-4e14-b64d-2c50f13a7532 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:49:31.206171 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG oslo_concurrency.lockutils [None req-b41052cd-b497-4e14-b64d-2c50f13a7532 None None] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:49:31.208156 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG oslo_concurrency.lockutils [None req-b41052cd-b497-4e14-b64d-2c50f13a7532 None None] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:49:31.210143 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: INFO dbcounter [None req-b41052cd-b497-4e14-b64d-2c50f13a7532 None None] Registered counter for database nova_cell0 Jul 30 04:49:31.212864 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.context [None req-cb1f6919-ef78-4fbe-a1f2-f70bc1d75cb9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),25ab7be4-4766-4eb8-ab18-1f848f2f4df6(cell1) {{(pid=103188) load_cells /opt/stack/nova/nova/context.py:464}} Jul 30 04:49:31.215992 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: INFO dbcounter [None req-b41052cd-b497-4e14-b64d-2c50f13a7532 None None] Registered counter for database nova_cell1 Jul 30 04:49:31.216821 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG oslo_concurrency.lockutils [None req-cb1f6919-ef78-4fbe-a1f2-f70bc1d75cb9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:49:31.218380 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG oslo_concurrency.lockutils [None req-cb1f6919-ef78-4fbe-a1f2-f70bc1d75cb9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:49:31.219233 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG oslo_concurrency.lockutils [None req-cb1f6919-ef78-4fbe-a1f2-f70bc1d75cb9 None None] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:49:31.221190 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG oslo_concurrency.lockutils [None req-cb1f6919-ef78-4fbe-a1f2-f70bc1d75cb9 None None] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:49:31.223093 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG oslo_db.sqlalchemy.engines [None req-b41052cd-b497-4e14-b64d-2c50f13a7532 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103189) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 30 04:49:31.223241 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: INFO dbcounter [None req-cb1f6919-ef78-4fbe-a1f2-f70bc1d75cb9 None None] Registered counter for database nova_cell0 Jul 30 04:49:31.225047 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG oslo_db.sqlalchemy.engines [None req-b41052cd-b497-4e14-b64d-2c50f13a7532 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103189) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 30 04:49:31.230002 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: INFO dbcounter [None req-cb1f6919-ef78-4fbe-a1f2-f70bc1d75cb9 None None] Registered counter for database nova_cell1 Jul 30 04:49:31.230838 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG dbcounter [-] [103189] Writer thread running {{(pid=103189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 30 04:49:31.233470 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG dbcounter [-] [103189] Writer thread running {{(pid=103189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 30 04:49:31.237266 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG oslo_db.sqlalchemy.engines [None req-cb1f6919-ef78-4fbe-a1f2-f70bc1d75cb9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103188) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 30 04:49:31.239457 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG oslo_db.sqlalchemy.engines [None req-cb1f6919-ef78-4fbe-a1f2-f70bc1d75cb9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103188) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 30 04:49:31.245711 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG dbcounter [-] [103188] Writer thread running {{(pid=103188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 30 04:49:31.247214 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG dbcounter [-] [103188] Writer thread running {{(pid=103188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 30 04:49:31.376089 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: INFO dbcounter [None req-b41052cd-b497-4e14-b64d-2c50f13a7532 None None] Registered counter for database nova_cell0 Jul 30 04:49:31.383970 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG oslo_db.sqlalchemy.engines [None req-b41052cd-b497-4e14-b64d-2c50f13a7532 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103189) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 30 04:49:31.388825 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG dbcounter [-] [103189] Writer thread running {{(pid=103189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 30 04:49:31.391636 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: INFO dbcounter [None req-cb1f6919-ef78-4fbe-a1f2-f70bc1d75cb9 None None] Registered counter for database nova_cell0 Jul 30 04:49:31.399206 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG oslo_db.sqlalchemy.engines [None req-cb1f6919-ef78-4fbe-a1f2-f70bc1d75cb9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103188) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 30 04:49:31.403424 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG dbcounter [-] [103188] Writer thread running {{(pid=103188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 30 04:49:31.731714 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: WARNING keystonemiddleware.auth_token [None req-cb1f6919-ef78-4fbe-a1f2-f70bc1d75cb9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 30 04:49:31.733248 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: WARNING keystonemiddleware.auth_token [None req-b41052cd-b497-4e14-b64d-2c50f13a7532 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 30 04:49:31.738924 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: WARNING keystonemiddleware.auth_token [None req-cb1f6919-ef78-4fbe-a1f2-f70bc1d75cb9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 30 04:49:31.741147 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: WARNING keystonemiddleware.auth_token [None req-b41052cd-b497-4e14-b64d-2c50f13a7532 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 30 04:49:32.081619 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: WARNING keystonemiddleware.auth_token [None req-cb1f6919-ef78-4fbe-a1f2-f70bc1d75cb9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 30 04:49:32.087477 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: WARNING keystonemiddleware.auth_token [None req-b41052cd-b497-4e14-b64d-2c50f13a7532 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 30 04:49:32.088146 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: WARNING keystonemiddleware.auth_token [None req-cb1f6919-ef78-4fbe-a1f2-f70bc1d75cb9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 30 04:49:32.093372 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: WARNING keystonemiddleware.auth_token [None req-b41052cd-b497-4e14-b64d-2c50f13a7532 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 30 04:49:32.093499 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5603a220b9c0 pid: 103188 (default app) Jul 30 04:49:32.095519 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi [None req-cb1f6919-ef78-4fbe-a1f2-f70bc1d75cb9 None None] Calling method '>' {{(pid=103188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:49:32.096687 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: INFO nova.api.openstack.requestlog [None req-cb1f6919-ef78-4fbe-a1f2-f70bc1d75cb9 None None] 10.222.0.20 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001724 Jul 30 04:49:32.097100 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: [pid: 103188|app: 0|req: 1/1] 10.222.0.20 () {50 vars in 788 bytes} [Sat Jul 30 04:49:32 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 04:49:32.098670 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5603a220b9c0 pid: 103189 (default app) Jul 30 04:50:47.726245 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi [None req-cb1f6919-ef78-4fbe-a1f2-f70bc1d75cb9 None None] Calling method '>' {{(pid=103188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:50:47.727330 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: INFO nova.api.openstack.requestlog [None req-cb1f6919-ef78-4fbe-a1f2-f70bc1d75cb9 None None] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001510 Jul 30 04:50:47.727715 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: [pid: 103188|app: 0|req: 2/2] 10.222.0.20 () {54 vars in 930 bytes} [Sat Jul 30 04:50:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 04:50:47.739965 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG dbcounter [-] [103189] Writing DB stats nova_api:SELECT=3 {{(pid=103189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 04:50:47.741068 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG dbcounter [-] [103189] Writing DB stats nova_cell0:SELECT=3 {{(pid=103189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 04:50:47.741915 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG dbcounter [-] [103189] Writing DB stats nova_cell1:SELECT=3 {{(pid=103189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 04:50:47.742917 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG dbcounter [-] [103189] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 04:50:48.603124 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi [None req-4dd7e290-4b7b-4a8b-accb-07b451e66e1d admin admin] Calling method '>' {{(pid=103189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:50:48.635663 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: INFO nova.api.openstack.requestlog [None req-4dd7e290-4b7b-4a8b-accb-07b451e66e1d admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.900713 Jul 30 04:50:48.637415 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: [pid: 103189|app: 0|req: 1/3] 10.222.0.20 () {60 vars in 1291 bytes} [Sat Jul 30 04:50:47 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:50:50.864726 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi [None req-cb1f6919-ef78-4fbe-a1f2-f70bc1d75cb9 None None] Calling method '>' {{(pid=103188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:50:50.865857 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: INFO nova.api.openstack.requestlog [None req-cb1f6919-ef78-4fbe-a1f2-f70bc1d75cb9 None None] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001545 Jul 30 04:50:50.866372 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: [pid: 103188|app: 0|req: 3/4] 10.222.0.20 () {54 vars in 930 bytes} [Sat Jul 30 04:50:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 04:50:51.341390 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi [None req-fb8afe1d-986e-45ca-9997-adf9dc249b53 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "disk": 1, "ram": 256, "id": "c1", "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 1}} {{(pid=103189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 04:50:51.361850 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 04:50:51.361850 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: warnings.warn(msg) Jul 30 04:50:51.391385 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: INFO nova.api.openstack.requestlog [None req-fb8afe1d-986e-45ca-9997-adf9dc249b53 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.518287 Jul 30 04:50:51.391940 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: [pid: 103189|app: 0|req: 2/5] 10.222.0.20 () {64 vars in 1282 bytes} [Sat Jul 30 04:50:50 2022] POST /compute/v2.1/flavors => generated 407 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 04:50:51.630275 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi [None req-dbb96f2b-f16e-4507-985b-08f378282766 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 04:50:51.634795 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 04:50:51.634795 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: warnings.warn(msg) Jul 30 04:50:51.638320 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG dbcounter [-] [103188] Writing DB stats nova_api:SELECT=3 {{(pid=103188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 04:50:51.639304 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG dbcounter [-] [103188] Writing DB stats nova_cell0:SELECT=3 {{(pid=103188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 04:50:51.640154 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG dbcounter [-] [103188] Writing DB stats nova_cell1:SELECT=3 {{(pid=103188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 04:50:51.641007 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG dbcounter [-] [103188] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 04:50:51.708021 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: INFO nova.api.openstack.requestlog [None req-dbb96f2b-f16e-4507-985b-08f378282766 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.307689 Jul 30 04:50:51.719392 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: [pid: 103188|app: 0|req: 4/6] 10.222.0.20 () {64 vars in 1335 bytes} [Sat Jul 30 04:50:51 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:50:53.964240 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi [None req-fb8afe1d-986e-45ca-9997-adf9dc249b53 admin admin] Calling method '>' {{(pid=103189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:50:53.966033 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: INFO nova.api.openstack.requestlog [None req-fb8afe1d-986e-45ca-9997-adf9dc249b53 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002876 Jul 30 04:50:53.966940 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: [pid: 103189|app: 0|req: 3/7] 10.222.0.20 () {54 vars in 930 bytes} [Sat Jul 30 04:50:53 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 04:50:54.624201 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi [None req-d0188b12-8fd9-446c-8b8f-e4e08881f200 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "name": "ds512M", "id": "d1", "disk": 5, "ram": 512, "vcpus": 1, "rxtx_factor": 1.0}} {{(pid=103188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 04:50:54.643835 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 04:50:54.643835 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: warnings.warn(msg) Jul 30 04:50:54.663430 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: INFO nova.api.openstack.requestlog [None req-d0188b12-8fd9-446c-8b8f-e4e08881f200 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.690801 Jul 30 04:50:54.664170 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: [pid: 103188|app: 0|req: 5/8] 10.222.0.20 () {64 vars in 1282 bytes} [Sat Jul 30 04:50:53 2022] POST /compute/v2.1/flavors => generated 404 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 04:50:54.676353 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi [None req-bee51d07-318b-497f-b2e9-437b3304450d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 04:50:54.679180 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 04:50:54.679180 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: warnings.warn(msg) Jul 30 04:50:54.712583 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: INFO nova.api.openstack.requestlog [None req-bee51d07-318b-497f-b2e9-437b3304450d admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039834 Jul 30 04:50:54.713171 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: [pid: 103189|app: 0|req: 4/9] 10.222.0.20 () {64 vars in 1335 bytes} [Sat Jul 30 04:50:54 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:50:56.930811 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi [None req-d0188b12-8fd9-446c-8b8f-e4e08881f200 admin admin] Calling method '>' {{(pid=103188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:50:56.933730 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: INFO nova.api.openstack.requestlog [None req-d0188b12-8fd9-446c-8b8f-e4e08881f200 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Jul 30 04:50:56.938770 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: [pid: 103188|app: 0|req: 6/10] 10.222.0.20 () {54 vars in 930 bytes} [Sat Jul 30 04:50:56 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 04:50:57.390224 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi [None req-e8280b0a-79fd-4f63-984f-38c0e1160121 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "ds1G", "rxtx_factor": 1.0, "id": "d2", "disk": 10, "vcpus": 1, "ram": 1024, "swap": 0}} {{(pid=103189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 04:50:57.408799 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: INFO nova.api.openstack.requestlog [None req-e8280b0a-79fd-4f63-984f-38c0e1160121 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.470177 Jul 30 04:50:57.409351 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: [pid: 103189|app: 0|req: 5/11] 10.222.0.20 () {64 vars in 1282 bytes} [Sat Jul 30 04:50:56 2022] POST /compute/v2.1/flavors => generated 404 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 30 04:50:57.421612 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi [None req-7f873f87-feb2-456c-9cf2-149705b6d71a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 04:50:57.445898 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: INFO nova.api.openstack.requestlog [None req-7f873f87-feb2-456c-9cf2-149705b6d71a admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027855 Jul 30 04:50:57.446487 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: [pid: 103188|app: 0|req: 7/12] 10.222.0.20 () {64 vars in 1335 bytes} [Sat Jul 30 04:50:57 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 04:50:59.683166 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi [None req-e8280b0a-79fd-4f63-984f-38c0e1160121 admin admin] Calling method '>' {{(pid=103189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:50:59.684183 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: INFO nova.api.openstack.requestlog [None req-e8280b0a-79fd-4f63-984f-38c0e1160121 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Jul 30 04:50:59.684590 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: [pid: 103189|app: 0|req: 6/13] 10.222.0.20 () {54 vars in 930 bytes} [Sat Jul 30 04:50:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 04:51:00.116103 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi [None req-feb3d41a-e797-4939-81f0-65c33727b1ad admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "swap": 0, "rxtx_factor": 1.0, "disk": 10, "ram": 2048, "os-flavor-access:is_public": true, "id": "d3", "name": "ds2G"}} {{(pid=103188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 04:51:00.141788 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: INFO nova.api.openstack.requestlog [None req-feb3d41a-e797-4939-81f0-65c33727b1ad admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.450825 Jul 30 04:51:00.142605 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: [pid: 103188|app: 0|req: 8/14] 10.222.0.20 () {64 vars in 1282 bytes} [Sat Jul 30 04:50:59 2022] POST /compute/v2.1/flavors => generated 404 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 04:51:00.160276 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi [None req-6eeab3e6-dd17-49ce-b20f-d9c02db6c41f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 04:51:00.191387 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: INFO nova.api.openstack.requestlog [None req-6eeab3e6-dd17-49ce-b20f-d9c02db6c41f admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035774 Jul 30 04:51:00.192113 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: [pid: 103189|app: 0|req: 7/15] 10.222.0.20 () {64 vars in 1335 bytes} [Sat Jul 30 04:51:00 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 04:51:02.432375 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi [None req-feb3d41a-e797-4939-81f0-65c33727b1ad admin admin] Calling method '>' {{(pid=103188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:51:02.433315 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: INFO nova.api.openstack.requestlog [None req-feb3d41a-e797-4939-81f0-65c33727b1ad admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002096 Jul 30 04:51:02.433866 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: [pid: 103188|app: 0|req: 9/16] 10.222.0.20 () {54 vars in 930 bytes} [Sat Jul 30 04:51:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 04:51:02.879233 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi [None req-07281e60-daee-4d73-a99d-3dd26d1744fe admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "os-flavor-access:is_public": true, "ram": 4096, "name": "ds4G", "disk": 20, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "d4"}} {{(pid=103189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 04:51:02.898827 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: INFO nova.api.openstack.requestlog [None req-07281e60-daee-4d73-a99d-3dd26d1744fe admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.459306 Jul 30 04:51:02.899662 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: [pid: 103189|app: 0|req: 8/17] 10.222.0.20 () {64 vars in 1282 bytes} [Sat Jul 30 04:51:02 2022] POST /compute/v2.1/flavors => generated 404 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 04:51:02.913154 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi [None req-040f03ca-1ef1-48f8-888d-d6a6366e0d9c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 04:51:02.938574 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: INFO nova.api.openstack.requestlog [None req-040f03ca-1ef1-48f8-888d-d6a6366e0d9c admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029462 Jul 30 04:51:02.939297 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: [pid: 103188|app: 0|req: 10/18] 10.222.0.20 () {64 vars in 1335 bytes} [Sat Jul 30 04:51:02 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:51:05.439824 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi [None req-07281e60-daee-4d73-a99d-3dd26d1744fe admin admin] Calling method '>' {{(pid=103189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:51:05.440896 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: INFO nova.api.openstack.requestlog [None req-07281e60-daee-4d73-a99d-3dd26d1744fe admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001515 Jul 30 04:51:05.441299 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: [pid: 103189|app: 0|req: 9/19] 10.222.0.20 () {54 vars in 930 bytes} [Sat Jul 30 04:51:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 04:51:05.870456 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi [None req-d1b7a0da-a44c-4bda-8be4-66137ab41fc3 admin admin] Calling method '>' {{(pid=103188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:51:05.894779 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: INFO nova.api.openstack.requestlog [None req-d1b7a0da-a44c-4bda-8be4-66137ab41fc3 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.446659 Jul 30 04:51:05.895357 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: [pid: 103188|app: 0|req: 11/20] 10.222.0.20 () {60 vars in 1291 bytes} [Sat Jul 30 04:51:05 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 04:51:08.614053 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi [None req-07281e60-daee-4d73-a99d-3dd26d1744fe admin admin] Calling method '>' {{(pid=103189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:51:08.615107 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: INFO nova.api.openstack.requestlog [None req-07281e60-daee-4d73-a99d-3dd26d1744fe admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Jul 30 04:51:08.615515 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: [pid: 103189|app: 0|req: 10/21] 10.222.0.20 () {54 vars in 930 bytes} [Sat Jul 30 04:51:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 04:51:09.067967 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi [None req-de7d8338-f98f-466d-9221-cee5d19b3a34 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "1", "ram": 512, "rxtx_factor": 1.0, "name": "m1.tiny", "os-flavor-access:is_public": true, "swap": 0, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 04:51:09.091819 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: INFO nova.api.openstack.requestlog [None req-de7d8338-f98f-466d-9221-cee5d19b3a34 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.469397 Jul 30 04:51:09.092721 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: [pid: 103188|app: 0|req: 12/22] 10.222.0.20 () {64 vars in 1282 bytes} [Sat Jul 30 04:51:08 2022] POST /compute/v2.1/flavors => generated 402 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 30 04:51:09.104774 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi [None req-5f65b016-5996-4a25-b240-cff178910dbe admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 04:51:09.133082 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: INFO nova.api.openstack.requestlog [None req-5f65b016-5996-4a25-b240-cff178910dbe admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032288 Jul 30 04:51:09.134343 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: [pid: 103189|app: 0|req: 11/23] 10.222.0.20 () {64 vars in 1332 bytes} [Sat Jul 30 04:51:09 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:51:11.346902 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi [None req-de7d8338-f98f-466d-9221-cee5d19b3a34 admin admin] Calling method '>' {{(pid=103188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:51:11.347955 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: INFO nova.api.openstack.requestlog [None req-de7d8338-f98f-466d-9221-cee5d19b3a34 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001507 Jul 30 04:51:11.348361 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: [pid: 103188|app: 0|req: 13/24] 10.222.0.20 () {54 vars in 930 bytes} [Sat Jul 30 04:51:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 04:51:11.764704 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi [None req-df6b49c4-d6ee-4a60-a82e-9741dd3f9eb6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "vcpus": 1, "name": "m1.small", "swap": 0, "id": "2", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 20}} {{(pid=103189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 04:51:11.784756 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: INFO nova.api.openstack.requestlog [None req-df6b49c4-d6ee-4a60-a82e-9741dd3f9eb6 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.430382 Jul 30 04:51:11.785421 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: [pid: 103189|app: 0|req: 12/25] 10.222.0.20 () {64 vars in 1282 bytes} [Sat Jul 30 04:51:11 2022] POST /compute/v2.1/flavors => generated 405 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 04:51:11.797198 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi [None req-e5ed9fa1-8751-49da-b61d-48f111d07bd2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 04:51:11.825911 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: INFO nova.api.openstack.requestlog [None req-e5ed9fa1-8751-49da-b61d-48f111d07bd2 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029918 Jul 30 04:51:11.828696 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: [pid: 103188|app: 0|req: 14/26] 10.222.0.20 () {64 vars in 1332 bytes} [Sat Jul 30 04:51:11 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:51:14.056700 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi [None req-df6b49c4-d6ee-4a60-a82e-9741dd3f9eb6 admin admin] Calling method '>' {{(pid=103189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:51:14.057526 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: INFO nova.api.openstack.requestlog [None req-df6b49c4-d6ee-4a60-a82e-9741dd3f9eb6 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Jul 30 04:51:14.057933 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: [pid: 103189|app: 0|req: 13/27] 10.222.0.20 () {54 vars in 930 bytes} [Sat Jul 30 04:51:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 04:51:14.448943 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi [None req-7a162b0e-8da1-43d0-b321-2150105f8ee9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 4096, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "3", "disk": 40}} {{(pid=103188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 04:51:14.469359 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: INFO nova.api.openstack.requestlog [None req-7a162b0e-8da1-43d0-b321-2150105f8ee9 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.405521 Jul 30 04:51:14.470181 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: [pid: 103188|app: 0|req: 15/28] 10.222.0.20 () {64 vars in 1282 bytes} [Sat Jul 30 04:51:14 2022] POST /compute/v2.1/flavors => generated 406 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 30 04:51:14.482571 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi [None req-38cc5441-e5ab-4096-934b-f947f720cfd1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 04:51:14.507537 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: INFO nova.api.openstack.requestlog [None req-38cc5441-e5ab-4096-934b-f947f720cfd1 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028637 Jul 30 04:51:14.508655 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: [pid: 103189|app: 0|req: 14/29] 10.222.0.20 () {64 vars in 1332 bytes} [Sat Jul 30 04:51:14 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:51:16.751604 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi [None req-7a162b0e-8da1-43d0-b321-2150105f8ee9 admin admin] Calling method '>' {{(pid=103188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:51:16.754733 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: INFO nova.api.openstack.requestlog [None req-7a162b0e-8da1-43d0-b321-2150105f8ee9 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003212 Jul 30 04:51:16.756585 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: [pid: 103188|app: 0|req: 16/30] 10.222.0.20 () {54 vars in 930 bytes} [Sat Jul 30 04:51:16 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 04:51:17.380064 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi [None req-14f8f359-2461-428a-bcfc-2180381e090f admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "id": "4", "vcpus": 4, "ram": 8192, "os-flavor-access:is_public": true, "name": "m1.large", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=103189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 04:51:17.402381 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: INFO nova.api.openstack.requestlog [None req-14f8f359-2461-428a-bcfc-2180381e090f admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.640123 Jul 30 04:51:17.402961 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: [pid: 103189|app: 0|req: 15/31] 10.222.0.20 () {64 vars in 1282 bytes} [Sat Jul 30 04:51:16 2022] POST /compute/v2.1/flavors => generated 405 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 04:51:17.415460 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi [None req-1a964f9b-7452-44e6-b344-b32ccadc21b0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 04:51:17.440673 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: INFO nova.api.openstack.requestlog [None req-1a964f9b-7452-44e6-b344-b32ccadc21b0 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029436 Jul 30 04:51:17.441948 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: [pid: 103188|app: 0|req: 17/32] 10.222.0.20 () {64 vars in 1332 bytes} [Sat Jul 30 04:51:17 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 04:51:19.723519 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi [None req-14f8f359-2461-428a-bcfc-2180381e090f admin admin] Calling method '>' {{(pid=103189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:51:19.724536 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: INFO nova.api.openstack.requestlog [None req-14f8f359-2461-428a-bcfc-2180381e090f admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Jul 30 04:51:19.725067 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: [pid: 103189|app: 0|req: 16/33] 10.222.0.20 () {54 vars in 930 bytes} [Sat Jul 30 04:51:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 04:51:20.177943 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi [None req-d0bebd81-8666-4aef-82f9-7a96ee4dbfe0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "m1.xlarge", "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "disk": 160, "id": "5", "rxtx_factor": 1.0, "swap": 0}} {{(pid=103188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 04:51:20.199790 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: INFO nova.api.openstack.requestlog [None req-d0bebd81-8666-4aef-82f9-7a96ee4dbfe0 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.468573 Jul 30 04:51:20.200431 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: [pid: 103188|app: 0|req: 18/34] 10.222.0.20 () {64 vars in 1282 bytes} [Sat Jul 30 04:51:19 2022] POST /compute/v2.1/flavors => generated 408 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 04:51:20.215419 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi [None req-ce51acde-a8ee-4bc6-8e2e-ab334ec480e2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 04:51:20.220276 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG dbcounter [-] [103189] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 04:51:20.242670 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: INFO nova.api.openstack.requestlog [None req-ce51acde-a8ee-4bc6-8e2e-ab334ec480e2 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033959 Jul 30 04:51:20.243241 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: [pid: 103189|app: 0|req: 17/35] 10.222.0.20 () {64 vars in 1332 bytes} [Sat Jul 30 04:51:20 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 04:51:39.516328 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi [None req-d0bebd81-8666-4aef-82f9-7a96ee4dbfe0 admin admin] Calling method '>' {{(pid=103188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:51:39.517324 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: INFO nova.api.openstack.requestlog [None req-d0bebd81-8666-4aef-82f9-7a96ee4dbfe0 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 Jul 30 04:51:39.517720 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: [pid: 103188|app: 0|req: 19/36] 10.222.0.20 () {54 vars in 930 bytes} [Sat Jul 30 04:51:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 04:51:39.910365 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi [None req-32a5f608-6cd9-4f98-b20b-ab0971537611 admin admin] Calling method '>' {{(pid=103189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:51:39.929754 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: INFO nova.api.openstack.requestlog [None req-32a5f608-6cd9-4f98-b20b-ab0971537611 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.405461 Jul 30 04:51:39.930229 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: [pid: 103189|app: 0|req: 18/37] 10.222.0.20 () {60 vars in 1291 bytes} [Sat Jul 30 04:51:39 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 04:51:40.998351 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi [None req-d0bebd81-8666-4aef-82f9-7a96ee4dbfe0 admin admin] Calling method '>' {{(pid=103188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:51:40.999377 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: INFO nova.api.openstack.requestlog [None req-d0bebd81-8666-4aef-82f9-7a96ee4dbfe0 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Jul 30 04:51:40.999779 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: [pid: 103188|app: 0|req: 20/38] 10.222.0.20 () {56 vars in 1074 bytes} [Sat Jul 30 04:51:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 04:51:41.525356 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi [None req-e3ba0725-d854-4d14-b095-5da047625daa admin admin] Calling method '>' {{(pid=103189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:51:41.530990 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: INFO nova.api.openstack.wsgi [None req-e3ba0725-d854-4d14-b095-5da047625daa admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 30 04:51:41.534205 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi [None req-e3ba0725-d854-4d14-b095-5da047625daa admin admin] Request method failure captured: Jul 30 04:51:41.534205 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 30 04:51:41.534205 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: Accept: application/json Jul 30 04:51:41.534205 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: Accept-Encoding: gzip, deflate Jul 30 04:51:41.534205 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: Connection: keep-alive Jul 30 04:51:41.534205 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: Content-Length: 0 Jul 30 04:51:41.534205 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: Host: 10.222.0.20 Jul 30 04:51:41.534205 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: Openstack-Api-Version: compute 2.90 Jul 30 04:51:41.534205 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: Openstack-System-Scope: None Jul 30 04:51:41.534205 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: User-Agent: python-novaclient Jul 30 04:51:41.534205 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: X-Auth-Token: gAAAAABi5LjczsjGn3se4ui1lHRvELEdmng5qTJQK9--V2pp6Vi1Sf7u_Yft-CKOPcF0DjjKd-nG0SXe-3klbI4zE7HcuDpdO_cZZxUNT4MmZ3vMHfJM4wKB7BfgkIb-pMQkcVc3ZGS8jHcrJPJbbuqAux3_LaG8xtakMOlVWW8Wdl1FzF5y4po Jul 30 04:51:41.534205 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: X-Domain-Id: None Jul 30 04:51:41.534205 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: X-Domain-Name: None Jul 30 04:51:41.534205 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: X-Identity-Status: Confirmed Jul 30 04:51:41.534205 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: X-Is-Admin-Project: True Jul 30 04:51:41.534205 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: X-Openstack-Nova-Api-Version: 2.90 Jul 30 04:51:41.534205 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: X-Project-Domain-Id: default Jul 30 04:51:41.534205 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: X-Project-Domain-Name: Default Jul 30 04:51:41.534205 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: X-Project-Id: 2e75ff1f24d24ead87dfc7d32ddc1723 Jul 30 04:51:41.534205 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: X-Project-Name: admin Jul 30 04:51:41.534205 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: X-Role: member,admin,reader Jul 30 04:51:41.534205 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: X-Roles: member,admin,reader Jul 30 04:51:41.535710 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2e75ff1f24d24ead87dfc7d32ddc1723"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2e75ff1f24d24ead87dfc7d32ddc1723"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2e75ff1f24d24ead87dfc7d32ddc1723"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2e75ff1f24d24ead87dfc7d32ddc1723"}]}] Jul 30 04:51:41.535710 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: X-Tenant: admin Jul 30 04:51:41.535710 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: X-Tenant-Id: 2e75ff1f24d24ead87dfc7d32ddc1723 Jul 30 04:51:41.535710 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: X-Tenant-Name: admin Jul 30 04:51:41.535710 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: X-User: admin Jul 30 04:51:41.535710 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: X-User-Domain-Id: default Jul 30 04:51:41.535710 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: X-User-Domain-Name: Default Jul 30 04:51:41.535710 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: X-User-Id: 74c09f97e34c428a84e13d34f5105ca9 Jul 30 04:51:41.535710 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: X-User-Name: admin Jul 30 04:51:41.535710 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: method: > Jul 30 04:51:41.535710 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: exception: Flavor 42 could not be found. Jul 30 04:51:41.535710 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: action_args: {'id': '42'} Jul 30 04:51:41.535710 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: {{(pid=103189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 04:51:41.535710 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 04:51:41.536563 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 30 04:51:41.536563 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 30 04:51:41.536563 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 30 04:51:41.536563 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 30 04:51:41.536563 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 30 04:51:41.536563 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 30 04:51:41.536563 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 30 04:51:41.536563 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 30 04:51:41.536563 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 30 04:51:41.536563 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 04:51:41.536563 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 30 04:51:41.536563 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 30 04:51:41.536563 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 30 04:51:41.536563 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: ERROR nova.api.openstack.wsgi Jul 30 04:51:41.536563 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 04:51:41.536563 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: ERROR nova.api.openstack.wsgi Jul 30 04:51:41.536563 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 04:51:41.536563 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 04:51:41.536563 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 04:51:41.537873 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 04:51:41.537873 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 04:51:41.537873 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 04:51:41.537873 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 04:51:41.537873 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 30 04:51:41.537873 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 30 04:51:41.537873 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 30 04:51:41.537873 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: ERROR nova.api.openstack.wsgi Jul 30 04:51:41.537873 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 04:51:41.537873 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: ERROR nova.api.openstack.wsgi Jul 30 04:51:41.537873 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 04:51:41.537873 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 04:51:41.537873 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 04:51:41.537873 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 04:51:41.537873 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 04:51:41.537873 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 30 04:51:41.537873 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: ERROR nova.api.openstack.wsgi Jul 30 04:51:41.537873 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi [None req-e3ba0725-d854-4d14-b095-5da047625daa admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103189) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 04:51:41.540064 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: INFO nova.api.openstack.requestlog [None req-e3ba0725-d854-4d14-b095-5da047625daa admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.394592 Jul 30 04:51:41.540064 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: [pid: 103189|app: 0|req: 19/39] 10.222.0.20 () {60 vars in 1190 bytes} [Sat Jul 30 04:51:41 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 396 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 30 04:51:41.545794 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi [None req-112f02d7-9490-492e-ae08-82c2bbf904ae admin admin] Calling method '>' {{(pid=103188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:51:41.549883 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG dbcounter [-] [103188] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 04:51:41.569513 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: INFO nova.api.openstack.requestlog [None req-112f02d7-9490-492e-ae08-82c2bbf904ae admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027222 Jul 30 04:51:41.570056 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: [pid: 103188|app: 0|req: 21/40] 10.222.0.20 () {60 vars in 1210 bytes} [Sat Jul 30 04:51:41 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 04:51:41.580003 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi [None req-3f97c848-2b48-4693-be61-4ae74f7de4c0 admin admin] Calling method '>' {{(pid=103189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:51:41.603869 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: INFO nova.api.openstack.requestlog [None req-3f97c848-2b48-4693-be61-4ae74f7de4c0 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027504 Jul 30 04:51:41.604393 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: [pid: 103189|app: 0|req: 20/41] 10.222.0.20 () {60 vars in 1210 bytes} [Sat Jul 30 04:51:41 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 04:51:41.613708 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi [None req-520bd2e6-7098-4330-84b3-78fca744c831 admin admin] Calling method '>' {{(pid=103188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:51:41.620841 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: INFO nova.api.openstack.wsgi [None req-520bd2e6-7098-4330-84b3-78fca744c831 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 30 04:51:41.624324 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi [None req-520bd2e6-7098-4330-84b3-78fca744c831 admin admin] Request method failure captured: Jul 30 04:51:41.624324 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 30 04:51:41.624324 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: Accept: application/json Jul 30 04:51:41.624324 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: Accept-Encoding: gzip, deflate Jul 30 04:51:41.624324 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: Connection: keep-alive Jul 30 04:51:41.624324 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: Content-Length: 0 Jul 30 04:51:41.624324 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: Host: 10.222.0.20 Jul 30 04:51:41.624324 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: Openstack-Api-Version: compute 2.90 Jul 30 04:51:41.624324 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: Openstack-System-Scope: None Jul 30 04:51:41.624324 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: User-Agent: python-novaclient Jul 30 04:51:41.624324 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: X-Auth-Token: gAAAAABi5LjczsjGn3se4ui1lHRvELEdmng5qTJQK9--V2pp6Vi1Sf7u_Yft-CKOPcF0DjjKd-nG0SXe-3klbI4zE7HcuDpdO_cZZxUNT4MmZ3vMHfJM4wKB7BfgkIb-pMQkcVc3ZGS8jHcrJPJbbuqAux3_LaG8xtakMOlVWW8Wdl1FzF5y4po Jul 30 04:51:41.624324 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: X-Domain-Id: None Jul 30 04:51:41.624324 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: X-Domain-Name: None Jul 30 04:51:41.624324 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: X-Identity-Status: Confirmed Jul 30 04:51:41.624324 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: X-Is-Admin-Project: True Jul 30 04:51:41.624324 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: X-Openstack-Nova-Api-Version: 2.90 Jul 30 04:51:41.624324 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: X-Project-Domain-Id: default Jul 30 04:51:41.624324 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: X-Project-Domain-Name: Default Jul 30 04:51:41.624324 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: X-Project-Id: 2e75ff1f24d24ead87dfc7d32ddc1723 Jul 30 04:51:41.624324 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: X-Project-Name: admin Jul 30 04:51:41.624324 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: X-Role: member,admin,reader Jul 30 04:51:41.624324 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: X-Roles: member,admin,reader Jul 30 04:51:41.625868 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2e75ff1f24d24ead87dfc7d32ddc1723"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2e75ff1f24d24ead87dfc7d32ddc1723"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2e75ff1f24d24ead87dfc7d32ddc1723"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2e75ff1f24d24ead87dfc7d32ddc1723"}]}] Jul 30 04:51:41.625868 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: X-Tenant: admin Jul 30 04:51:41.625868 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: X-Tenant-Id: 2e75ff1f24d24ead87dfc7d32ddc1723 Jul 30 04:51:41.625868 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: X-Tenant-Name: admin Jul 30 04:51:41.625868 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: X-User: admin Jul 30 04:51:41.625868 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: X-User-Domain-Id: default Jul 30 04:51:41.625868 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: X-User-Domain-Name: Default Jul 30 04:51:41.625868 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: X-User-Id: 74c09f97e34c428a84e13d34f5105ca9 Jul 30 04:51:41.625868 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: X-User-Name: admin Jul 30 04:51:41.625868 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: method: > Jul 30 04:51:41.625868 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: exception: Flavor 42 could not be found. Jul 30 04:51:41.625868 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: action_args: {'id': '42'} Jul 30 04:51:41.625868 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: {{(pid=103188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 04:51:41.625868 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 04:51:41.627067 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 30 04:51:41.627067 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 30 04:51:41.627067 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 30 04:51:41.627067 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 30 04:51:41.627067 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 30 04:51:41.627067 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 30 04:51:41.627067 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 30 04:51:41.627067 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 30 04:51:41.627067 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 30 04:51:41.627067 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 04:51:41.627067 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 30 04:51:41.627067 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 30 04:51:41.627067 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 30 04:51:41.627067 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi Jul 30 04:51:41.627067 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 04:51:41.627067 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi Jul 30 04:51:41.627067 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 04:51:41.627067 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 04:51:41.627067 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 04:51:41.628329 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 04:51:41.628329 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 04:51:41.628329 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 04:51:41.628329 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 04:51:41.628329 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 30 04:51:41.628329 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 30 04:51:41.628329 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 30 04:51:41.628329 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi Jul 30 04:51:41.628329 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 04:51:41.628329 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi Jul 30 04:51:41.628329 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 04:51:41.628329 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 04:51:41.628329 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 04:51:41.628329 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 04:51:41.628329 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 04:51:41.628329 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 30 04:51:41.628329 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi Jul 30 04:51:41.628329 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi [None req-520bd2e6-7098-4330-84b3-78fca744c831 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103188) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 04:51:41.629942 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: INFO nova.api.openstack.requestlog [None req-520bd2e6-7098-4330-84b3-78fca744c831 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015722 Jul 30 04:51:41.629942 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: [pid: 103188|app: 0|req: 22/42] 10.222.0.20 () {60 vars in 1190 bytes} [Sat Jul 30 04:51:41 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 30 04:51:42.594121 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi [None req-3f97c848-2b48-4693-be61-4ae74f7de4c0 admin admin] Calling method '>' {{(pid=103189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:51:42.595175 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: INFO nova.api.openstack.requestlog [None req-3f97c848-2b48-4693-be61-4ae74f7de4c0 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Jul 30 04:51:42.595573 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: [pid: 103189|app: 0|req: 21/43] 10.222.0.20 () {56 vars in 1074 bytes} [Sat Jul 30 04:51:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 04:51:43.118692 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi [None req-741b1007-222c-4594-b3e6-32c45fa80311 admin admin] Calling method '>' {{(pid=103188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:51:43.125979 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: INFO nova.api.openstack.wsgi [None req-741b1007-222c-4594-b3e6-32c45fa80311 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 30 04:51:43.127515 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi [None req-741b1007-222c-4594-b3e6-32c45fa80311 admin admin] Request method failure captured: Jul 30 04:51:43.127515 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 30 04:51:43.127515 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: Accept: application/json Jul 30 04:51:43.127515 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: Accept-Encoding: gzip, deflate Jul 30 04:51:43.127515 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: Connection: keep-alive Jul 30 04:51:43.127515 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: Content-Length: 0 Jul 30 04:51:43.127515 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: Host: 10.222.0.20 Jul 30 04:51:43.127515 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: Openstack-Api-Version: compute 2.90 Jul 30 04:51:43.127515 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: Openstack-System-Scope: None Jul 30 04:51:43.127515 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: User-Agent: python-novaclient Jul 30 04:51:43.127515 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: X-Auth-Token: gAAAAABi5LjexOrwfWKu2kbOa_HpzxHGPh5StoMTsC5ZAUxTtf6rMIxFTotW8dodkU9YbQ4YJ3tPtxZsKlQbqpydM8whQZvyMhZygSOAHksxHzUXk8sabehJH6bwmDFn7HDWoKDAZlb7lpP_CgdfEet9JeNqY1kxMHi6SovFdqFN-Hb2UQWdOW4 Jul 30 04:51:43.127515 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: X-Domain-Id: None Jul 30 04:51:43.127515 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: X-Domain-Name: None Jul 30 04:51:43.127515 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: X-Identity-Status: Confirmed Jul 30 04:51:43.127515 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: X-Is-Admin-Project: True Jul 30 04:51:43.127515 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: X-Openstack-Nova-Api-Version: 2.90 Jul 30 04:51:43.127515 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: X-Project-Domain-Id: default Jul 30 04:51:43.127515 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: X-Project-Domain-Name: Default Jul 30 04:51:43.127515 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: X-Project-Id: 2e75ff1f24d24ead87dfc7d32ddc1723 Jul 30 04:51:43.127515 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: X-Project-Name: admin Jul 30 04:51:43.127515 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: X-Role: member,admin,reader Jul 30 04:51:43.127515 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: X-Roles: member,admin,reader Jul 30 04:51:43.129293 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2e75ff1f24d24ead87dfc7d32ddc1723"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2e75ff1f24d24ead87dfc7d32ddc1723"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2e75ff1f24d24ead87dfc7d32ddc1723"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2e75ff1f24d24ead87dfc7d32ddc1723"}]}] Jul 30 04:51:43.129293 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: X-Tenant: admin Jul 30 04:51:43.129293 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: X-Tenant-Id: 2e75ff1f24d24ead87dfc7d32ddc1723 Jul 30 04:51:43.129293 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: X-Tenant-Name: admin Jul 30 04:51:43.129293 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: X-User: admin Jul 30 04:51:43.129293 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: X-User-Domain-Id: default Jul 30 04:51:43.129293 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: X-User-Domain-Name: Default Jul 30 04:51:43.129293 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: X-User-Id: 74c09f97e34c428a84e13d34f5105ca9 Jul 30 04:51:43.129293 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: X-User-Name: admin Jul 30 04:51:43.129293 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: method: > Jul 30 04:51:43.129293 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: exception: Flavor 84 could not be found. Jul 30 04:51:43.129293 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: action_args: {'id': '84'} Jul 30 04:51:43.129293 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: {{(pid=103188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 04:51:43.129293 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 04:51:43.130418 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 30 04:51:43.130418 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 30 04:51:43.130418 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 30 04:51:43.130418 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 30 04:51:43.130418 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 30 04:51:43.130418 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 30 04:51:43.130418 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 30 04:51:43.130418 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 30 04:51:43.130418 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 30 04:51:43.130418 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 04:51:43.130418 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 30 04:51:43.130418 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 30 04:51:43.130418 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 30 04:51:43.130418 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi Jul 30 04:51:43.130418 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 04:51:43.130418 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi Jul 30 04:51:43.130418 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 04:51:43.130418 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 04:51:43.130418 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 04:51:43.131846 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 04:51:43.131846 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 04:51:43.131846 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 04:51:43.131846 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 04:51:43.131846 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 30 04:51:43.131846 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 30 04:51:43.131846 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 30 04:51:43.131846 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi Jul 30 04:51:43.131846 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 04:51:43.131846 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi Jul 30 04:51:43.131846 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 04:51:43.131846 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 04:51:43.131846 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 04:51:43.131846 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 04:51:43.131846 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 04:51:43.131846 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 30 04:51:43.131846 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi Jul 30 04:51:43.131846 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi [None req-741b1007-222c-4594-b3e6-32c45fa80311 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103188) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 04:51:43.133073 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: INFO nova.api.openstack.requestlog [None req-741b1007-222c-4594-b3e6-32c45fa80311 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.394420 Jul 30 04:51:43.133073 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: [pid: 103188|app: 0|req: 23/44] 10.222.0.20 () {60 vars in 1190 bytes} [Sat Jul 30 04:51:42 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 396 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 30 04:51:43.139553 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi [None req-0f92564f-2b39-468b-b424-4af5a82a1c15 admin admin] Calling method '>' {{(pid=103189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:51:43.154846 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: INFO nova.api.openstack.requestlog [None req-0f92564f-2b39-468b-b424-4af5a82a1c15 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018890 Jul 30 04:51:43.155380 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: [pid: 103189|app: 0|req: 22/45] 10.222.0.20 () {60 vars in 1210 bytes} [Sat Jul 30 04:51:43 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 04:51:43.164741 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi [None req-4df08bd7-733c-41f3-b90b-0694f868aaff admin admin] Calling method '>' {{(pid=103188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:51:43.180619 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: INFO nova.api.openstack.requestlog [None req-4df08bd7-733c-41f3-b90b-0694f868aaff admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018351 Jul 30 04:51:43.181253 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: [pid: 103188|app: 0|req: 24/46] 10.222.0.20 () {60 vars in 1210 bytes} [Sat Jul 30 04:51:43 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 04:51:43.190298 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi [None req-76bffad3-998c-4b78-a569-078ddb2a42f5 admin admin] Calling method '>' {{(pid=103189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:51:43.195593 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: INFO nova.api.openstack.wsgi [None req-76bffad3-998c-4b78-a569-078ddb2a42f5 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 30 04:51:43.197898 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi [None req-76bffad3-998c-4b78-a569-078ddb2a42f5 admin admin] Request method failure captured: Jul 30 04:51:43.197898 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 30 04:51:43.197898 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: Accept: application/json Jul 30 04:51:43.197898 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: Accept-Encoding: gzip, deflate Jul 30 04:51:43.197898 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: Connection: keep-alive Jul 30 04:51:43.197898 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: Content-Length: 0 Jul 30 04:51:43.197898 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: Host: 10.222.0.20 Jul 30 04:51:43.197898 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: Openstack-Api-Version: compute 2.90 Jul 30 04:51:43.197898 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: Openstack-System-Scope: None Jul 30 04:51:43.197898 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: User-Agent: python-novaclient Jul 30 04:51:43.197898 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: X-Auth-Token: gAAAAABi5LjexOrwfWKu2kbOa_HpzxHGPh5StoMTsC5ZAUxTtf6rMIxFTotW8dodkU9YbQ4YJ3tPtxZsKlQbqpydM8whQZvyMhZygSOAHksxHzUXk8sabehJH6bwmDFn7HDWoKDAZlb7lpP_CgdfEet9JeNqY1kxMHi6SovFdqFN-Hb2UQWdOW4 Jul 30 04:51:43.197898 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: X-Domain-Id: None Jul 30 04:51:43.197898 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: X-Domain-Name: None Jul 30 04:51:43.197898 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: X-Identity-Status: Confirmed Jul 30 04:51:43.197898 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: X-Is-Admin-Project: True Jul 30 04:51:43.197898 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: X-Openstack-Nova-Api-Version: 2.90 Jul 30 04:51:43.197898 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: X-Project-Domain-Id: default Jul 30 04:51:43.197898 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: X-Project-Domain-Name: Default Jul 30 04:51:43.197898 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: X-Project-Id: 2e75ff1f24d24ead87dfc7d32ddc1723 Jul 30 04:51:43.197898 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: X-Project-Name: admin Jul 30 04:51:43.197898 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: X-Role: member,admin,reader Jul 30 04:51:43.197898 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: X-Roles: member,admin,reader Jul 30 04:51:43.199452 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2e75ff1f24d24ead87dfc7d32ddc1723"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2e75ff1f24d24ead87dfc7d32ddc1723"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2e75ff1f24d24ead87dfc7d32ddc1723"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2e75ff1f24d24ead87dfc7d32ddc1723"}]}] Jul 30 04:51:43.199452 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: X-Tenant: admin Jul 30 04:51:43.199452 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: X-Tenant-Id: 2e75ff1f24d24ead87dfc7d32ddc1723 Jul 30 04:51:43.199452 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: X-Tenant-Name: admin Jul 30 04:51:43.199452 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: X-User: admin Jul 30 04:51:43.199452 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: X-User-Domain-Id: default Jul 30 04:51:43.199452 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: X-User-Domain-Name: Default Jul 30 04:51:43.199452 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: X-User-Id: 74c09f97e34c428a84e13d34f5105ca9 Jul 30 04:51:43.199452 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: X-User-Name: admin Jul 30 04:51:43.199452 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: method: > Jul 30 04:51:43.199452 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: exception: Flavor 84 could not be found. Jul 30 04:51:43.199452 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: action_args: {'id': '84'} Jul 30 04:51:43.199452 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: {{(pid=103189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 04:51:43.199452 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 04:51:43.200390 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 30 04:51:43.200390 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 30 04:51:43.200390 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 30 04:51:43.200390 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 30 04:51:43.200390 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 30 04:51:43.200390 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 30 04:51:43.200390 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 30 04:51:43.200390 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 30 04:51:43.200390 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 30 04:51:43.200390 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 04:51:43.200390 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 30 04:51:43.200390 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 30 04:51:43.200390 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 30 04:51:43.200390 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: ERROR nova.api.openstack.wsgi Jul 30 04:51:43.200390 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 04:51:43.200390 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: ERROR nova.api.openstack.wsgi Jul 30 04:51:43.200390 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 04:51:43.200390 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 04:51:43.200390 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 04:51:43.201645 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 04:51:43.201645 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 04:51:43.201645 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 04:51:43.201645 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 04:51:43.201645 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 30 04:51:43.201645 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 30 04:51:43.201645 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 30 04:51:43.201645 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: ERROR nova.api.openstack.wsgi Jul 30 04:51:43.201645 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 04:51:43.201645 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: ERROR nova.api.openstack.wsgi Jul 30 04:51:43.201645 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 04:51:43.201645 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 04:51:43.201645 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 04:51:43.201645 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 04:51:43.201645 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 04:51:43.201645 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 30 04:51:43.201645 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: ERROR nova.api.openstack.wsgi Jul 30 04:51:43.201645 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi [None req-76bffad3-998c-4b78-a569-078ddb2a42f5 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103189) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 04:51:43.202894 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: INFO nova.api.openstack.requestlog [None req-76bffad3-998c-4b78-a569-078ddb2a42f5 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012486 Jul 30 04:51:43.202894 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: [pid: 103189|app: 0|req: 23/47] 10.222.0.20 () {60 vars in 1190 bytes} [Sat Jul 30 04:51:43 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 30 04:51:44.160963 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi [None req-4df08bd7-733c-41f3-b90b-0694f868aaff admin admin] Calling method '>' {{(pid=103188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:51:44.162012 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: INFO nova.api.openstack.requestlog [None req-4df08bd7-733c-41f3-b90b-0694f868aaff admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Jul 30 04:51:44.162418 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: [pid: 103188|app: 0|req: 25/48] 10.222.0.20 () {56 vars in 1074 bytes} [Sat Jul 30 04:51:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 04:51:44.684857 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi [None req-cb8942b2-291f-4b6a-b18d-4b149d497864 admin admin] Calling method '>' {{(pid=103189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:51:44.690495 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: INFO nova.api.openstack.wsgi [None req-cb8942b2-291f-4b6a-b18d-4b149d497864 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 30 04:51:44.691978 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi [None req-cb8942b2-291f-4b6a-b18d-4b149d497864 admin admin] Request method failure captured: Jul 30 04:51:44.691978 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 30 04:51:44.691978 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: Accept: application/json Jul 30 04:51:44.691978 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: Accept-Encoding: gzip, deflate Jul 30 04:51:44.691978 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: Connection: keep-alive Jul 30 04:51:44.691978 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: Content-Length: 0 Jul 30 04:51:44.691978 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: Host: 10.222.0.20 Jul 30 04:51:44.691978 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: Openstack-Api-Version: compute 2.90 Jul 30 04:51:44.691978 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: Openstack-System-Scope: None Jul 30 04:51:44.691978 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: User-Agent: python-novaclient Jul 30 04:51:44.691978 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: X-Auth-Token: gAAAAABi5LjgV7McQUYBerCHMD9JKuAw9_ZXylG1MgVU83K0oYx8sZjRo0QbTle0bn6Igx-WH3LfAY6ICVoj3mpBz9fIhQQq2I-WtwrV-3ou7FjnoFxLSJKXUs0M9yk7MlImRlpLsTm10YnxbsYPMdwk-IrYqs0OA1uQfjY8tk7Q5BpD_LKRQgQ Jul 30 04:51:44.691978 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: X-Domain-Id: None Jul 30 04:51:44.691978 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: X-Domain-Name: None Jul 30 04:51:44.691978 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: X-Identity-Status: Confirmed Jul 30 04:51:44.691978 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: X-Is-Admin-Project: True Jul 30 04:51:44.691978 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: X-Openstack-Nova-Api-Version: 2.90 Jul 30 04:51:44.691978 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: X-Project-Domain-Id: default Jul 30 04:51:44.691978 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: X-Project-Domain-Name: Default Jul 30 04:51:44.691978 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: X-Project-Id: 2e75ff1f24d24ead87dfc7d32ddc1723 Jul 30 04:51:44.691978 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: X-Project-Name: admin Jul 30 04:51:44.691978 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: X-Role: member,admin,reader Jul 30 04:51:44.691978 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: X-Roles: member,admin,reader Jul 30 04:51:44.693286 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2e75ff1f24d24ead87dfc7d32ddc1723"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2e75ff1f24d24ead87dfc7d32ddc1723"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2e75ff1f24d24ead87dfc7d32ddc1723"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2e75ff1f24d24ead87dfc7d32ddc1723"}]}] Jul 30 04:51:44.693286 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: X-Tenant: admin Jul 30 04:51:44.693286 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: X-Tenant-Id: 2e75ff1f24d24ead87dfc7d32ddc1723 Jul 30 04:51:44.693286 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: X-Tenant-Name: admin Jul 30 04:51:44.693286 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: X-User: admin Jul 30 04:51:44.693286 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: X-User-Domain-Id: default Jul 30 04:51:44.693286 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: X-User-Domain-Name: Default Jul 30 04:51:44.693286 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: X-User-Id: 74c09f97e34c428a84e13d34f5105ca9 Jul 30 04:51:44.693286 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: X-User-Name: admin Jul 30 04:51:44.693286 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: method: > Jul 30 04:51:44.693286 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: exception: Flavor 451 could not be found. Jul 30 04:51:44.693286 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: action_args: {'id': '451'} Jul 30 04:51:44.693286 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: {{(pid=103189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 04:51:44.693286 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 04:51:44.694383 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 30 04:51:44.694383 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 30 04:51:44.694383 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 30 04:51:44.694383 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 30 04:51:44.694383 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 30 04:51:44.694383 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 30 04:51:44.694383 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 30 04:51:44.694383 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 30 04:51:44.694383 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 30 04:51:44.694383 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 04:51:44.694383 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 30 04:51:44.694383 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 30 04:51:44.694383 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 30 04:51:44.694383 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: ERROR nova.api.openstack.wsgi Jul 30 04:51:44.694383 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 04:51:44.694383 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: ERROR nova.api.openstack.wsgi Jul 30 04:51:44.694383 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 04:51:44.694383 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 04:51:44.694383 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 04:51:44.695835 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 04:51:44.695835 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 04:51:44.695835 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 04:51:44.695835 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 04:51:44.695835 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 30 04:51:44.695835 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 30 04:51:44.695835 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 30 04:51:44.695835 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: ERROR nova.api.openstack.wsgi Jul 30 04:51:44.695835 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 04:51:44.695835 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: ERROR nova.api.openstack.wsgi Jul 30 04:51:44.695835 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 04:51:44.695835 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 04:51:44.695835 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 04:51:44.695835 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 04:51:44.695835 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 04:51:44.695835 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 30 04:51:44.695835 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: ERROR nova.api.openstack.wsgi Jul 30 04:51:44.695835 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi [None req-cb8942b2-291f-4b6a-b18d-4b149d497864 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103189) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 04:51:44.697635 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: INFO nova.api.openstack.requestlog [None req-cb8942b2-291f-4b6a-b18d-4b149d497864 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.388883 Jul 30 04:51:44.697635 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: [pid: 103189|app: 0|req: 24/49] 10.222.0.20 () {60 vars in 1193 bytes} [Sat Jul 30 04:51:44 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 390 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 30 04:51:44.703937 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi [None req-e1e58eed-f735-4e65-8d15-e70d5f07ca58 admin admin] Calling method '>' {{(pid=103188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:51:44.719165 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: INFO nova.api.openstack.requestlog [None req-e1e58eed-f735-4e65-8d15-e70d5f07ca58 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018757 Jul 30 04:51:44.719687 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: [pid: 103188|app: 0|req: 26/50] 10.222.0.20 () {60 vars in 1210 bytes} [Sat Jul 30 04:51:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 04:51:44.729985 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi [None req-4f2642bf-d4c5-4a45-8e28-056b3636b35f admin admin] Calling method '>' {{(pid=103189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:51:44.744680 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: INFO nova.api.openstack.requestlog [None req-4f2642bf-d4c5-4a45-8e28-056b3636b35f admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019160 Jul 30 04:51:44.745213 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: [pid: 103189|app: 0|req: 25/51] 10.222.0.20 () {60 vars in 1210 bytes} [Sat Jul 30 04:51:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 04:51:44.754410 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi [None req-5d1fa7ed-b81b-4a41-86c0-2d2d82c5e369 admin admin] Calling method '>' {{(pid=103188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:51:44.760658 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: INFO nova.api.openstack.wsgi [None req-5d1fa7ed-b81b-4a41-86c0-2d2d82c5e369 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 30 04:51:44.762150 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi [None req-5d1fa7ed-b81b-4a41-86c0-2d2d82c5e369 admin admin] Request method failure captured: Jul 30 04:51:44.762150 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 30 04:51:44.762150 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: Accept: application/json Jul 30 04:51:44.762150 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: Accept-Encoding: gzip, deflate Jul 30 04:51:44.762150 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: Connection: keep-alive Jul 30 04:51:44.762150 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: Content-Length: 0 Jul 30 04:51:44.762150 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: Host: 10.222.0.20 Jul 30 04:51:44.762150 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: Openstack-Api-Version: compute 2.90 Jul 30 04:51:44.762150 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: Openstack-System-Scope: None Jul 30 04:51:44.762150 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: User-Agent: python-novaclient Jul 30 04:51:44.762150 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: X-Auth-Token: gAAAAABi5LjgV7McQUYBerCHMD9JKuAw9_ZXylG1MgVU83K0oYx8sZjRo0QbTle0bn6Igx-WH3LfAY6ICVoj3mpBz9fIhQQq2I-WtwrV-3ou7FjnoFxLSJKXUs0M9yk7MlImRlpLsTm10YnxbsYPMdwk-IrYqs0OA1uQfjY8tk7Q5BpD_LKRQgQ Jul 30 04:51:44.762150 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: X-Domain-Id: None Jul 30 04:51:44.762150 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: X-Domain-Name: None Jul 30 04:51:44.762150 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: X-Identity-Status: Confirmed Jul 30 04:51:44.762150 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: X-Is-Admin-Project: True Jul 30 04:51:44.762150 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: X-Openstack-Nova-Api-Version: 2.90 Jul 30 04:51:44.762150 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: X-Project-Domain-Id: default Jul 30 04:51:44.762150 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: X-Project-Domain-Name: Default Jul 30 04:51:44.762150 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: X-Project-Id: 2e75ff1f24d24ead87dfc7d32ddc1723 Jul 30 04:51:44.762150 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: X-Project-Name: admin Jul 30 04:51:44.762150 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: X-Role: member,admin,reader Jul 30 04:51:44.762150 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: X-Roles: member,admin,reader Jul 30 04:51:44.763857 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2e75ff1f24d24ead87dfc7d32ddc1723"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2e75ff1f24d24ead87dfc7d32ddc1723"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2e75ff1f24d24ead87dfc7d32ddc1723"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2e75ff1f24d24ead87dfc7d32ddc1723"}]}] Jul 30 04:51:44.763857 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: X-Tenant: admin Jul 30 04:51:44.763857 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: X-Tenant-Id: 2e75ff1f24d24ead87dfc7d32ddc1723 Jul 30 04:51:44.763857 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: X-Tenant-Name: admin Jul 30 04:51:44.763857 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: X-User: admin Jul 30 04:51:44.763857 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: X-User-Domain-Id: default Jul 30 04:51:44.763857 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: X-User-Domain-Name: Default Jul 30 04:51:44.763857 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: X-User-Id: 74c09f97e34c428a84e13d34f5105ca9 Jul 30 04:51:44.763857 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: X-User-Name: admin Jul 30 04:51:44.763857 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: method: > Jul 30 04:51:44.763857 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: exception: Flavor 451 could not be found. Jul 30 04:51:44.763857 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: action_args: {'id': '451'} Jul 30 04:51:44.763857 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: {{(pid=103188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 04:51:44.763857 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 04:51:44.765011 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 30 04:51:44.765011 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 30 04:51:44.765011 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 30 04:51:44.765011 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 30 04:51:44.765011 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 30 04:51:44.765011 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 30 04:51:44.765011 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 30 04:51:44.765011 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 30 04:51:44.765011 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 30 04:51:44.765011 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 04:51:44.765011 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 30 04:51:44.765011 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 30 04:51:44.765011 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 30 04:51:44.765011 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi Jul 30 04:51:44.765011 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 04:51:44.765011 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi Jul 30 04:51:44.765011 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 04:51:44.765011 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 04:51:44.765011 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 04:51:44.766554 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 04:51:44.766554 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 04:51:44.766554 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 04:51:44.766554 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 04:51:44.766554 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 30 04:51:44.766554 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 30 04:51:44.766554 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 30 04:51:44.766554 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi Jul 30 04:51:44.766554 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 04:51:44.766554 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi Jul 30 04:51:44.766554 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 04:51:44.766554 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 04:51:44.766554 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 04:51:44.766554 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 04:51:44.766554 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 04:51:44.766554 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 30 04:51:44.766554 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: ERROR nova.api.openstack.wsgi Jul 30 04:51:44.766554 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi [None req-5d1fa7ed-b81b-4a41-86c0-2d2d82c5e369 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103188) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 04:51:44.767837 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: INFO nova.api.openstack.requestlog [None req-5d1fa7ed-b81b-4a41-86c0-2d2d82c5e369 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012702 Jul 30 04:51:44.767837 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: [pid: 103188|app: 0|req: 27/52] 10.222.0.20 () {60 vars in 1193 bytes} [Sat Jul 30 04:51:44 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 30 04:51:45.739653 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi [None req-4f2642bf-d4c5-4a45-8e28-056b3636b35f admin admin] Calling method '>' {{(pid=103189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:51:45.740652 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: INFO nova.api.openstack.requestlog [None req-4f2642bf-d4c5-4a45-8e28-056b3636b35f admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Jul 30 04:51:45.741037 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: [pid: 103189|app: 0|req: 26/53] 10.222.0.20 () {56 vars in 1074 bytes} [Sat Jul 30 04:51:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 04:51:46.270829 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi [None req-934a23f9-ce4e-44f5-8355-d93c129b91a0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 04:51:46.291569 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: INFO nova.api.openstack.requestlog [None req-934a23f9-ce4e-44f5-8355-d93c129b91a0 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.409552 Jul 30 04:51:46.292120 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: [pid: 103188|app: 0|req: 28/54] 10.222.0.20 () {64 vars in 1235 bytes} [Sat Jul 30 04:51:45 2022] POST /compute/v2.1/flavors => generated 404 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 04:51:47.257594 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi [None req-4f2642bf-d4c5-4a45-8e28-056b3636b35f admin admin] Calling method '>' {{(pid=103189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:51:47.258662 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: INFO nova.api.openstack.requestlog [None req-4f2642bf-d4c5-4a45-8e28-056b3636b35f admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Jul 30 04:51:47.259057 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: [pid: 103189|app: 0|req: 27/55] 10.222.0.20 () {56 vars in 1074 bytes} [Sat Jul 30 04:51:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 04:51:47.783909 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi [None req-f216f93c-39a1-42b5-8f66-046e8cd46daa admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 04:51:47.802242 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: INFO nova.api.openstack.requestlog [None req-f216f93c-39a1-42b5-8f66-046e8cd46daa admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.404246 Jul 30 04:51:47.802807 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: [pid: 103188|app: 0|req: 29/56] 10.222.0.20 () {64 vars in 1235 bytes} [Sat Jul 30 04:51:47 2022] POST /compute/v2.1/flavors => generated 405 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 04:51:48.774507 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi [None req-4f2642bf-d4c5-4a45-8e28-056b3636b35f admin admin] Calling method '>' {{(pid=103189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:51:48.775502 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: INFO nova.api.openstack.requestlog [None req-4f2642bf-d4c5-4a45-8e28-056b3636b35f admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Jul 30 04:51:48.775886 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: [pid: 103189|app: 0|req: 28/57] 10.222.0.20 () {56 vars in 1074 bytes} [Sat Jul 30 04:51:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 04:51:49.300489 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi [None req-9176126c-2124-494c-a4dd-eb9b2000bad8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 04:51:49.319431 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: INFO nova.api.openstack.requestlog [None req-9176126c-2124-494c-a4dd-eb9b2000bad8 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.406734 Jul 30 04:51:49.319967 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: [pid: 103188|app: 0|req: 30/58] 10.222.0.20 () {64 vars in 1235 bytes} [Sat Jul 30 04:51:48 2022] POST /compute/v2.1/flavors => generated 407 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 04:51:50.316968 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi [None req-4f2642bf-d4c5-4a45-8e28-056b3636b35f admin admin] Calling method '>' {{(pid=103189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:51:50.317958 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: INFO nova.api.openstack.requestlog [None req-4f2642bf-d4c5-4a45-8e28-056b3636b35f admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001397 Jul 30 04:51:50.318344 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: [pid: 103189|app: 0|req: 29/59] 10.222.0.20 () {56 vars in 1074 bytes} [Sat Jul 30 04:51:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 04:51:50.846009 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi [None req-6de50835-686c-4905-925c-b6b2b6c299d8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 04:51:50.865647 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: INFO nova.api.openstack.requestlog [None req-6de50835-686c-4905-925c-b6b2b6c299d8 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.403464 Jul 30 04:51:50.866308 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: [pid: 103188|app: 0|req: 31/60] 10.222.0.20 () {64 vars in 1235 bytes} [Sat Jul 30 04:51:50 2022] POST /compute/v2.1/flavors => generated 409 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 04:51:51.834553 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi [None req-4f2642bf-d4c5-4a45-8e28-056b3636b35f admin admin] Calling method '>' {{(pid=103189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:51:51.835635 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: INFO nova.api.openstack.requestlog [None req-4f2642bf-d4c5-4a45-8e28-056b3636b35f admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001558 Jul 30 04:51:51.836111 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: [pid: 103189|app: 0|req: 30/61] 10.222.0.20 () {56 vars in 1074 bytes} [Sat Jul 30 04:51:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 04:51:52.359711 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi [None req-5c34cc45-3430-4baa-8045-4708ec11aacd admin admin] Calling method '>' {{(pid=103188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:51:52.380459 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: INFO nova.api.openstack.requestlog [None req-5c34cc45-3430-4baa-8045-4708ec11aacd admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.402518 Jul 30 04:51:52.380992 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: [pid: 103188|app: 0|req: 32/62] 10.222.0.20 () {60 vars in 1202 bytes} [Sat Jul 30 04:51:51 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 04:52:43.917219 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi [None req-4f2642bf-d4c5-4a45-8e28-056b3636b35f admin admin] Calling method '>' {{(pid=103189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:52:43.918217 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: INFO nova.api.openstack.requestlog [None req-4f2642bf-d4c5-4a45-8e28-056b3636b35f admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Jul 30 04:52:43.918640 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: [pid: 103189|app: 0|req: 31/63] 10.222.0.20 () {54 vars in 930 bytes} [Sat Jul 30 04:52:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 04:52:43.928866 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG dbcounter [-] [103188] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 04:52:44.309652 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi [None req-7bf824c6-ffa6-4f49-b3ae-f00210de0ce1 admin admin] Calling method '>' {{(pid=103188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:52:44.336795 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: INFO nova.api.openstack.requestlog [None req-7bf824c6-ffa6-4f49-b3ae-f00210de0ce1 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.412356 Jul 30 04:52:44.337331 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: [pid: 103188|app: 0|req: 33/64] 10.222.0.20 () {60 vars in 1291 bytes} [Sat Jul 30 04:52:43 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 04:52:44.360700 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi [None req-6c77b058-9f8b-4646-8424-ea26b8a64156 admin admin] Calling method '>' {{(pid=103189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:52:44.364243 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG dbcounter [-] [103189] Writing DB stats nova_api:SELECT=19,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=103189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 04:52:44.370023 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: INFO nova.api.openstack.requestlog [None req-6c77b058-9f8b-4646-8424-ea26b8a64156 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012936 Jul 30 04:52:44.371175 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: [pid: 103189|app: 0|req: 32/65] 10.222.0.20 () {60 vars in 1282 bytes} [Sat Jul 30 04:52:44 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:52:44.382807 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi [None req-c3a4dcfe-8966-4610-9727-bedfc15949a0 admin admin] Calling method '>' {{(pid=103188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:52:44.391401 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: INFO nova.api.openstack.requestlog [None req-c3a4dcfe-8966-4610-9727-bedfc15949a0 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012191 Jul 30 04:52:44.391911 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: [pid: 103188|app: 0|req: 34/66] 10.222.0.20 () {60 vars in 1285 bytes} [Sat Jul 30 04:52:44 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 04:52:44.404036 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi [None req-3069529e-8ef6-4eaa-aa4d-b100db19f484 admin admin] Calling method '>' {{(pid=103189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:52:44.411866 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: INFO nova.api.openstack.requestlog [None req-3069529e-8ef6-4eaa-aa4d-b100db19f484 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012351 Jul 30 04:52:44.412386 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: [pid: 103189|app: 0|req: 33/67] 10.222.0.20 () {60 vars in 1285 bytes} [Sat Jul 30 04:52:44 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:52:44.423884 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi [None req-460e110d-eefc-4343-9fcd-f7707efd2524 admin admin] Calling method '>' {{(pid=103188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:52:44.431348 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: INFO nova.api.openstack.requestlog [None req-460e110d-eefc-4343-9fcd-f7707efd2524 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011003 Jul 30 04:52:44.431849 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: [pid: 103188|app: 0|req: 35/68] 10.222.0.20 () {60 vars in 1282 bytes} [Sat Jul 30 04:52:44 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 04:56:10.359468 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi [None req-3069529e-8ef6-4eaa-aa4d-b100db19f484 admin admin] Calling method '>' {{(pid=103189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:56:10.360672 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: INFO nova.api.openstack.requestlog [None req-3069529e-8ef6-4eaa-aa4d-b100db19f484 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Jul 30 04:56:10.361006 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: [pid: 103189|app: 0|req: 34/69] 10.222.0.20 () {56 vars in 1074 bytes} [Sat Jul 30 04:56:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 04:56:10.504573 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG dbcounter [-] [103188] Writing DB stats nova_api:SELECT=6 {{(pid=103188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 04:56:10.662876 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi [None req-f7648e5f-c99e-456d-961b-83d1bc45cccd admin admin] Calling method '>' {{(pid=103188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:56:10.665203 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 04:56:10.665203 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: warnings.warn(msg) Jul 30 04:56:10.666580 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG oslo_concurrency.lockutils [None req-f7648e5f-c99e-456d-961b-83d1bc45cccd admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:56:10.667056 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG oslo_concurrency.lockutils [None req-f7648e5f-c99e-456d-961b-83d1bc45cccd admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:56:10.667969 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG oslo_concurrency.lockutils [None req-f7648e5f-c99e-456d-961b-83d1bc45cccd admin admin] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:56:10.668470 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG oslo_concurrency.lockutils [None req-f7648e5f-c99e-456d-961b-83d1bc45cccd admin admin] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:56:10.704159 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: INFO nova.api.openstack.requestlog [None req-f7648e5f-c99e-456d-961b-83d1bc45cccd admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.200925 Jul 30 04:56:10.704712 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: [pid: 103188|app: 0|req: 36/70] 10.222.0.20 () {60 vars in 1193 bytes} [Sat Jul 30 04:56:10 2022] GET /compute/v2.1/os-services => generated 791 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 04:56:11.530664 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi [None req-3069529e-8ef6-4eaa-aa4d-b100db19f484 admin admin] Calling method '>' {{(pid=103189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:56:11.531665 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: INFO nova.api.openstack.requestlog [None req-3069529e-8ef6-4eaa-aa4d-b100db19f484 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Jul 30 04:56:11.532059 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: [pid: 103189|app: 0|req: 35/71] 10.222.0.20 () {56 vars in 1074 bytes} [Sat Jul 30 04:56:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 04:56:11.726780 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi [None req-2ea9baf5-24b7-46da-a23c-35e04031d569 admin admin] Calling method '>' {{(pid=103188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:56:11.729180 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 04:56:11.729180 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: warnings.warn(msg) Jul 30 04:56:11.730407 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG oslo_concurrency.lockutils [None req-2ea9baf5-24b7-46da-a23c-35e04031d569 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:56:11.731589 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG oslo_concurrency.lockutils [None req-2ea9baf5-24b7-46da-a23c-35e04031d569 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:56:11.732422 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG oslo_concurrency.lockutils [None req-2ea9baf5-24b7-46da-a23c-35e04031d569 admin admin] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:56:11.732881 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG oslo_concurrency.lockutils [None req-2ea9baf5-24b7-46da-a23c-35e04031d569 admin admin] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:56:11.752921 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: INFO nova.api.openstack.requestlog [None req-2ea9baf5-24b7-46da-a23c-35e04031d569 admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.079728 Jul 30 04:56:11.753429 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: [pid: 103188|app: 0|req: 37/72] 10.222.0.20 () {60 vars in 1193 bytes} [Sat Jul 30 04:56:11 2022] GET /compute/v2.1/os-services => generated 791 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 04:56:22.987120 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi [None req-3069529e-8ef6-4eaa-aa4d-b100db19f484 admin admin] Calling method '>' {{(pid=103189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:56:22.988112 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: INFO nova.api.openstack.requestlog [None req-3069529e-8ef6-4eaa-aa4d-b100db19f484 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Jul 30 04:56:22.988552 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: [pid: 103189|app: 0|req: 36/73] 10.222.0.20 () {56 vars in 1074 bytes} [Sat Jul 30 04:56:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 04:56:23.131372 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG dbcounter [-] [103188] Writing DB stats nova_cell0:SELECT=4 {{(pid=103188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 04:56:23.132086 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG dbcounter [-] [103188] Writing DB stats nova_cell1:SELECT=4 {{(pid=103188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 04:56:23.132939 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG dbcounter [-] [103188] Writing DB stats nova_api:SELECT=8 {{(pid=103188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 04:56:23.181855 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi [None req-3819b63f-ab64-4a11-b4f3-57bf87adc8f0 admin admin] Calling method '>' {{(pid=103188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:56:23.184218 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 04:56:23.184218 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: warnings.warn(msg) Jul 30 04:56:23.186113 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG oslo_concurrency.lockutils [None req-3819b63f-ab64-4a11-b4f3-57bf87adc8f0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:56:23.186584 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG oslo_concurrency.lockutils [None req-3819b63f-ab64-4a11-b4f3-57bf87adc8f0 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:56:23.187374 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG oslo_concurrency.lockutils [None req-3819b63f-ab64-4a11-b4f3-57bf87adc8f0 admin admin] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:56:23.187802 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG oslo_concurrency.lockutils [None req-3819b63f-ab64-4a11-b4f3-57bf87adc8f0 admin admin] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:56:23.211823 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: INFO nova.api.openstack.requestlog [None req-3819b63f-ab64-4a11-b4f3-57bf87adc8f0 admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.085216 Jul 30 04:56:23.212373 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: [pid: 103188|app: 0|req: 38/74] 10.222.0.20 () {60 vars in 1193 bytes} [Sat Jul 30 04:56:23 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 04:56:24.043777 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: DEBUG nova.api.openstack.wsgi [None req-3069529e-8ef6-4eaa-aa4d-b100db19f484 admin admin] Calling method '>' {{(pid=103189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:56:24.044908 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: INFO nova.api.openstack.requestlog [None req-3069529e-8ef6-4eaa-aa4d-b100db19f484 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001722 Jul 30 04:56:24.045309 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: [pid: 103189|app: 0|req: 37/75] 10.222.0.20 () {56 vars in 1074 bytes} [Sat Jul 30 04:56:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 04:56:24.234643 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG nova.api.openstack.wsgi [None req-11e8d36b-fbc4-46af-bd53-27745e43588e admin admin] Calling method '>' {{(pid=103188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:56:24.237064 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 30 04:56:24.237064 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: warnings.warn(msg) Jul 30 04:56:24.238249 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG oslo_concurrency.lockutils [None req-11e8d36b-fbc4-46af-bd53-27745e43588e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:56:24.238716 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG oslo_concurrency.lockutils [None req-11e8d36b-fbc4-46af-bd53-27745e43588e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:56:24.239506 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG oslo_concurrency.lockutils [None req-11e8d36b-fbc4-46af-bd53-27745e43588e admin admin] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:56:24.239963 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: DEBUG oslo_concurrency.lockutils [None req-11e8d36b-fbc4-46af-bd53-27745e43588e admin admin] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:56:24.261421 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: INFO nova.api.openstack.requestlog [None req-11e8d36b-fbc4-46af-bd53-27745e43588e admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.078367 Jul 30 04:56:24.261956 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: [pid: 103188|app: 0|req: 39/76] 10.222.0.20 () {60 vars in 1193 bytes} [Sat Jul 30 04:56:24 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 04:57:18.463711 dv-cinder-851279-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 30 04:57:18.464305 dv-cinder-851279-3-iscsi devstack@n-api.service[103187]: Sat Jul 30 04:57:18 2022 - graceful shutdown triggered... Jul 30 04:57:18.464779 dv-cinder-851279-3-iscsi devstack@n-api.service[103188]: Gracefully killing worker 1 (pid: 103188)... Jul 30 04:57:18.465892 dv-cinder-851279-3-iscsi devstack@n-api.service[103189]: Gracefully killing worker 2 (pid: 103189)... Jul 30 04:57:19.465467 dv-cinder-851279-3-iscsi devstack@n-api.service[103187]: worker 1 buried after 1 seconds Jul 30 04:57:19.466013 dv-cinder-851279-3-iscsi devstack@n-api.service[103187]: worker 2 buried after 1 seconds Jul 30 04:57:19.466013 dv-cinder-851279-3-iscsi devstack@n-api.service[103187]: goodbye to uWSGI. Jul 30 04:57:19.467110 dv-cinder-851279-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 30 04:57:19.467681 dv-cinder-851279-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 30 04:57:19.470554 dv-cinder-851279-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 30 04:57:19.488045 dv-cinder-851279-3-iscsi devstack@n-api.service[117867]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 30 04:57:19.490259 dv-cinder-851279-3-iscsi devstack@n-api.service[117867]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Jul 30 04:57:19 2022] *** Jul 30 04:57:19.490259 dv-cinder-851279-3-iscsi devstack@n-api.service[117867]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 30 04:57:19.490259 dv-cinder-851279-3-iscsi devstack@n-api.service[117867]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 30 04:57:19.490259 dv-cinder-851279-3-iscsi devstack@n-api.service[117867]: nodename: dv-cinder-851279-3-iscsi Jul 30 04:57:19.490259 dv-cinder-851279-3-iscsi devstack@n-api.service[117867]: machine: x86_64 Jul 30 04:57:19.490259 dv-cinder-851279-3-iscsi devstack@n-api.service[117867]: clock source: unix Jul 30 04:57:19.490259 dv-cinder-851279-3-iscsi devstack@n-api.service[117867]: pcre jit disabled Jul 30 04:57:19.490259 dv-cinder-851279-3-iscsi devstack@n-api.service[117867]: detected number of CPU cores: 4 Jul 30 04:57:19.490259 dv-cinder-851279-3-iscsi devstack@n-api.service[117867]: current working directory: / Jul 30 04:57:19.490259 dv-cinder-851279-3-iscsi devstack@n-api.service[117867]: detected binary path: /usr/bin/uwsgi-core Jul 30 04:57:19.491202 dv-cinder-851279-3-iscsi devstack@n-api.service[117867]: your processes number limit is 47680 Jul 30 04:57:19.491202 dv-cinder-851279-3-iscsi devstack@n-api.service[117867]: your memory page size is 4096 bytes Jul 30 04:57:19.491202 dv-cinder-851279-3-iscsi devstack@n-api.service[117867]: detected max file descriptor number: 2048 Jul 30 04:57:19.491202 dv-cinder-851279-3-iscsi devstack@n-api.service[117867]: lock engine: pthread robust mutexes Jul 30 04:57:19.491202 dv-cinder-851279-3-iscsi devstack@n-api.service[117867]: thunder lock: enabled Jul 30 04:57:19.491202 dv-cinder-851279-3-iscsi devstack@n-api.service[117867]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 30 04:57:19.491202 dv-cinder-851279-3-iscsi devstack@n-api.service[117867]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 30 04:57:19.536171 dv-cinder-851279-3-iscsi devstack@n-api.service[117867]: Python main interpreter initialized at 0x5600c35a19c0 Jul 30 04:57:19.536171 dv-cinder-851279-3-iscsi devstack@n-api.service[117867]: python threads support enabled Jul 30 04:57:19.536171 dv-cinder-851279-3-iscsi devstack@n-api.service[117867]: your server socket listen backlog is limited to 100 connections Jul 30 04:57:19.536171 dv-cinder-851279-3-iscsi devstack@n-api.service[117867]: your mercy for graceful operations on workers is 90 seconds Jul 30 04:57:19.536592 dv-cinder-851279-3-iscsi devstack@n-api.service[117867]: mapped 403077 bytes (393 KB) for 2 cores Jul 30 04:57:19.536592 dv-cinder-851279-3-iscsi devstack@n-api.service[117867]: *** Operational MODE: preforking *** Jul 30 04:57:19.536783 dv-cinder-851279-3-iscsi devstack@n-api.service[117867]: *** uWSGI is running in multiple interpreter mode *** Jul 30 04:57:19.536783 dv-cinder-851279-3-iscsi devstack@n-api.service[117867]: spawned uWSGI master process (pid: 117867) Jul 30 04:57:19.536996 dv-cinder-851279-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 30 04:57:19.537671 dv-cinder-851279-3-iscsi devstack@n-api.service[117867]: spawned uWSGI worker 1 (pid: 117885, cores: 1) Jul 30 04:57:19.538502 dv-cinder-851279-3-iscsi devstack@n-api.service[117867]: spawned uWSGI worker 2 (pid: 117886, cores: 1) Jul 30 04:57:19.539153 dv-cinder-851279-3-iscsi devstack@n-api.service[117867]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 30 04:57:20.206942 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 30 04:57:20.207521 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 30 04:57:21.378017 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 30 04:57:21.378017 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: from cryptography.utils import int_from_bytes Jul 30 04:57:21.378698 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 30 04:57:21.378698 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: from cryptography.utils import int_from_bytes Jul 30 04:57:21.382294 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 30 04:57:21.382294 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: from cryptography.utils import int_from_bytes Jul 30 04:57:21.382819 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 30 04:57:21.382819 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: from cryptography.utils import int_from_bytes Jul 30 04:57:23.808847 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 30 04:57:23.809401 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 30 04:57:23.809683 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 30 04:57:23.809918 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 30 04:57:23.810181 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 30 04:57:23.810601 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.810933 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.811260 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.811587 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.811940 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.812240 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.812570 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.812895 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.813249 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.813500 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.813818 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.814151 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-851279-3-iscsi {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.814495 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.814966 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.815289 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.815618 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.815931 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.816263 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.816601 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.817097 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.817225 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 30 04:57:23.817602 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 30 04:57:23.817938 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 30 04:57:23.818426 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 30 04:57:23.818578 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 30 04:57:23.818755 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.818967 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.819087 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.819298 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.819409 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.819628 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.819748 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.819951 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.820074 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.820298 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.820407 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.820606 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.820710 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.820927 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.821048 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.821247 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.821368 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.821561 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.821685 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.821860 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.821964 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-851279-3-iscsi {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.822154 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.822271 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.822563 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-851279-3-iscsi {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.822689 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.822879 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.822997 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.823276 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.823527 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.823769 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.823979 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.824214 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.824418 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.824649 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.824870 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.824870 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.825291 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.825506 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.825722 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.825963 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.826154 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.826351 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.826528 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.826686 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.826887 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.827068 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.827226 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.827368 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.827509 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.827695 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.827859 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.828013 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.828166 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.828308 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.828454 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.828602 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.828744 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.828925 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.828925 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.829252 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.829404 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.829555 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.829702 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.829865 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-851279-3-iscsi {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.830015 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.830163 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.830310 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.830499 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.830662 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.830817 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.830965 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.830965 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.831320 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.831320 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.831623 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.831774 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.831925 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.831925 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.832199 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.832654 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.835331 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.835518 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.836268 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.836494 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.836654 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.836835 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.837032 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.837195 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.837349 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.837620 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.837772 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.837921 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.838063 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.838224 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.838367 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.838557 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.838711 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.838853 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.839014 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.839166 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.839309 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.839309 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.839591 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.840234 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.842377 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.842591 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.842757 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.842911 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.843085 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.843290 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.843485 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.843643 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.843792 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.846356 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.846574 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.846749 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.846921 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.847124 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.847273 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.847414 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.847570 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.847727 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.847893 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.848043 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.848192 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.848342 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.848575 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.848732 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.848884 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.849026 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.849167 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.849308 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.849448 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.849602 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.849756 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.849903 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.850280 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.851729 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.851729 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.852044 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.852189 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.852340 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.852494 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.852643 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.852643 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.852922 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.853079 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.853244 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.853393 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.853534 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.853683 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.853825 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.853972 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.854879 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.855046 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.855191 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.855380 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.856138 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.856292 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.856449 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.856614 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.856756 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.857023 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.857237 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.857394 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.857549 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.858174 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.858347 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.858512 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.858669 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.858820 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.858962 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.859141 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.859314 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.859459 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.859602 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.860685 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.860854 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.861001 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.861150 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.861328 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.861489 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.861999 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.862154 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.862267 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.862421 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.864588 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.865700 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.865865 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.866013 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.866617 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.866813 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.867049 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.867249 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.867399 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.867542 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.867944 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.868131 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.868284 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.868434 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.868583 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.868724 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.868868 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.869017 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.869170 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.869318 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.869459 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.869606 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.869754 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.869958 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.870106 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.870247 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.870394 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.870651 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.870793 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.871187 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.871414 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.871616 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.871786 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.871991 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.872188 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.872342 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.872500 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.872661 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.872804 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.872944 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.873098 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.873241 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.873388 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.873538 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.873687 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.873837 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.873985 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.874183 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.874307 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.874497 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.874497 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.875033 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.875195 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.875363 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.875989 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.876209 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.876573 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.877096 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.877256 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.877452 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.877615 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.877770 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.877912 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.878061 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.878203 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.878352 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.878559 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.878719 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.878863 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.879013 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.879170 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.879313 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.879467 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.879617 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.879769 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.879911 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.880062 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.880273 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.880436 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.880586 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.880727 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.880875 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.882394 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.882796 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.882951 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.883111 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.883265 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.883494 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.883645 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 30 04:57:23.883798 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.883942 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.884091 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.884241 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.884383 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.884567 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.884884 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.885131 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.885296 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.885449 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.885633 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.886179 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.886371 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.886960 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.887469 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.887627 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.887771 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.887922 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.888073 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.888233 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.888383 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.888532 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.888715 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.888873 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.889024 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.889166 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.889348 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.889470 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.889580 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.889928 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.890089 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.890245 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.890387 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.890749 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.890961 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.891118 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.891281 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.891483 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.891631 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.891770 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.892038 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.892192 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.892304 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.892629 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.892724 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.892797 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.893116 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.893270 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.893407 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.893537 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.893712 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.893842 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.893971 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.894135 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.894236 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.894470 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.894598 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.894755 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.894885 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.895027 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.895167 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.895326 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.895455 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.895582 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.895708 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.895850 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.896324 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.896457 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.896570 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.897472 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.897737 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.897832 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.897832 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.898145 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.898290 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.898388 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.898579 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.898669 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.898760 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.898858 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.898858 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.899086 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.899173 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.899264 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.899355 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.899355 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.899355 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.899589 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.899589 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.899589 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.899822 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.899914 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.900004 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.900004 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.900174 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.900174 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.900335 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.900335 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.900502 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.900601 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.900686 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.900686 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.900846 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.900937 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.901028 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.901120 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.901205 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.901287 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.901376 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.901457 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.901546 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.901638 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.901728 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.901813 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.901901 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.901985 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.902084 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.902726 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.902858 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.902950 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.902950 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.903275 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.903403 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.903514 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.903640 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.903774 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.903909 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.904035 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.904170 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.904304 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.904393 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.904484 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.904581 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.904674 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.904766 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.904851 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.904940 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.905034 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.905034 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.905207 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.905292 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.905375 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.905464 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.905464 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.905464 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.905749 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.905840 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.905924 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.906014 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.906014 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.906206 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.906588 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.906685 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.906781 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.906870 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.906953 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.907045 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.907209 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.907299 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.907390 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.907482 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.907572 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.907733 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.907821 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.907821 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.907983 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.908073 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.908156 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.908251 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.908343 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.908427 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.908517 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.908607 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.908698 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.908789 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.908873 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.908956 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.909038 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.909120 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.909215 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.909299 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.909382 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.909472 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.909562 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.909651 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.909743 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.910030 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.910123 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.910255 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.910344 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.910451 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.910552 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.910647 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.910739 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.910863 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.910961 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.911046 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.911138 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.911223 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.911306 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.911389 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.911470 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.911561 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.911646 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.911728 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.911819 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.911902 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.911985 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.912076 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.912168 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.912299 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.912395 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.912479 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.912562 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.912654 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.912738 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.912821 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.912904 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.912994 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.913078 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.913169 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.913317 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.913498 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.913613 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.913720 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.913819 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.913943 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.914070 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.914224 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.914313 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.914395 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.914537 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.914624 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.914714 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.914797 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.914879 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.914961 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.915051 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.915189 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.915189 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.915355 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.915438 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.915528 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.915623 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.915708 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.915798 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.915888 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.915972 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.916062 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.916158 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.916243 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.916372 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.916535 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.916747 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.916856 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.916942 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.917025 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.917119 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.917200 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.917336 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.917336 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.917516 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.917608 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.917744 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.918466 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.918605 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.918776 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.918870 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.918954 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.919045 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.919136 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.919267 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.919369 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.919468 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.919560 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.919644 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.919735 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.919826 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.919916 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.920026 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.920155 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.920255 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.920340 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.920462 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.920579 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.920696 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.920805 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.920943 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.921038 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.921386 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.921477 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.921566 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.921650 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.921732 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.921814 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.921907 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.921986 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.922076 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.922166 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.922256 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.922352 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.922503 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.922592 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.922675 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.922757 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.922851 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.922944 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.923029 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.923111 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.923206 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.923346 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.923435 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.923542 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.923635 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.923727 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.923811 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.923900 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.923990 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.924081 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.924161 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.924244 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.924332 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.924427 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.924519 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.924603 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.924685 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.924766 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.924861 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.924951 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.925043 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.925127 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.925216 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.925300 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.925382 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.925470 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.925562 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.925653 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.925744 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.925827 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.925917 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.926007 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.926099 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.926182 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.926265 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.926265 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.926414 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.926526 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.926615 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.926695 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.926928 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.927031 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.927116 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.927207 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.927299 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.927424 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.927551 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.927646 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.927768 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.927871 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.927963 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.928056 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.928140 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.928223 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.928321 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.928405 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.928487 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.928571 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.928662 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.928746 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.928828 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.928917 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.929001 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.929083 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.929173 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.929258 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.929340 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.929421 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.929509 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.929599 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.929695 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.929780 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.929869 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.929953 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.930034 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.930125 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.930209 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.930330 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.930421 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.930549 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.930642 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.930740 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.930833 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.930917 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.931008 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.931100 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.931184 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.931278 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.931416 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.931416 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.931592 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.931683 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.931767 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.931859 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.931950 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.932034 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.932123 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.932213 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.932309 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.932401 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.932485 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.932599 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.932709 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.932807 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.932943 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.933036 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.933121 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.933204 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.933300 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.933423 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.933593 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.933693 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.933786 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.933881 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.933974 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.934109 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.934198 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.934290 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.934402 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.934557 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.934659 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.934776 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.934868 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.934960 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.935044 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.935137 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.935221 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.935310 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.935453 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.935603 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.935766 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.935919 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.936080 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.936227 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.936404 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.936542 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.936717 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.936999 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.937145 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.937282 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.937417 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.937548 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.937751 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.937889 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.938028 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.938157 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.938291 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.938566 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.938715 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.938844 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.938986 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.939125 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.939254 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.939382 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.939523 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.939659 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.939859 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.939986 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.940168 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.940313 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.940478 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.940621 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.940793 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.940926 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.941107 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.941252 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.941420 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.941561 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.941727 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.941861 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.942053 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.942192 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.942365 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.942508 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.942712 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.942855 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.943018 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.943158 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.943327 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.943457 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.943634 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.943763 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.943941 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.944084 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.944253 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.944378 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.944567 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.944697 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.944905 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.945036 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.945164 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.945292 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.945479 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.945612 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.945785 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.945924 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.946094 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.946235 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.946403 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.946609 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.946749 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.946867 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.947138 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.947278 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.947408 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.947546 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.947681 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.947817 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.947946 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.948080 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.948208 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.948344 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.948525 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.948665 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.948840 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.948972 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.949195 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.949343 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.949509 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.949656 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.949901 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.950039 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.950222 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.950367 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.950563 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.950704 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.950898 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.951038 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.951220 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.951359 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.951534 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.951667 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.951850 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.951982 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.952168 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.952300 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.952479 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.952617 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.952790 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.952923 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.953101 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.953218 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.953424 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.953557 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.953742 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.953875 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.954053 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.954191 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.954362 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.954520 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.954700 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.954848 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.955013 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.955143 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.955327 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.955459 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.955645 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.955784 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.955956 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.956095 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.956269 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.956401 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.956582 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.956726 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.956894 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.957025 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.957298 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.957435 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.957572 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.957699 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.957815 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.957955 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.958112 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.958244 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.958429 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.958593 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.958765 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.958902 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.959083 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.959214 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.959404 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.959544 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.959728 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.959861 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.960047 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.960180 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.960360 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.960493 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.960674 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.960802 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.960984 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.961118 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.961295 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.961435 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.961619 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.961749 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.961932 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.962076 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.962242 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.962374 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.962580 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.962722 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.962892 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.963032 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.963204 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.963348 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.963512 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.963650 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.963841 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.963985 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.964164 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.964303 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.965168 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.965304 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.965434 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.965571 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.965699 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.965919 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.966051 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.966266 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.966399 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.966624 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.966765 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.966947 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.967072 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.967338 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.967489 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.967627 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.967763 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.967892 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.968026 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.968198 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.968339 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.968521 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.968653 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.968845 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.968985 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.969170 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.969316 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.969497 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.969638 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.969808 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.969939 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.970118 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.970259 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.970428 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.970624 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.970754 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.970889 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.971074 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.971215 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.971402 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.971533 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.971772 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.971944 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.972066 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.972177 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.972329 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.972463 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.972640 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.972961 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.973154 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.973425 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.973590 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.973590 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.973854 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.973998 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.974128 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.974256 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.974391 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.974579 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.974739 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.974948 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.975079 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.975207 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.975335 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.975513 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.975645 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.975848 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.975982 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.976180 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.976313 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.976500 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.976632 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.976829 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.976990 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.977147 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.977265 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.977479 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.977617 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.977825 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.977941 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.978136 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.978298 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.978509 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.978674 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.978817 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.978966 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.979135 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.979278 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.979427 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.979598 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.979775 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.979925 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.980068 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.980218 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.980947 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.981096 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.981267 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.981425 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.981650 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.981811 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.981962 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.982113 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.982265 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.982406 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.982606 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.982776 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.982920 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.983061 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.983227 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.983383 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.983547 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.983707 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.983850 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.984020 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.984169 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.984356 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.984518 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.984662 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.984802 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.984983 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.985132 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.985303 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.985471 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.985642 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.985790 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.985977 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.986125 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.986284 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.986473 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.986623 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.986773 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.986924 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.987066 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.987270 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.987599 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.987599 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.987891 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.988035 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.988204 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.988357 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.988510 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.988659 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.988802 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.988951 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.989093 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.989247 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.989390 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.989539 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.989687 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.989829 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.989976 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.990126 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.990276 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.990466 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.990616 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.990769 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.990924 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.991066 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.991213 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.991384 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.991538 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.991688 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.991844 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.991994 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.992145 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.992294 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.992453 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.992605 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.992757 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.992906 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.993121 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.993271 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.993413 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.993561 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.993718 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.993868 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.994010 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.994152 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.994311 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.994486 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.994647 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.994798 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.994940 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.995088 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.995245 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.995400 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.995542 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.995692 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.995835 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.996494 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.996850 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.997670 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.997670 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.997974 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.998125 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.998268 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.998417 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.998678 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.998833 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.998984 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.999137 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.999287 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.999442 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.999585 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.999746 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:23.999898 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.000040 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.000189 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.000345 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.000488 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.000637 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.000779 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.000922 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.001064 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.001218 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.001368 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.001524 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.001666 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.001817 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.001968 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.002119 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.002262 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.002411 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.002616 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.002761 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.002904 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.003056 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.003206 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.003350 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.003502 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.003651 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.003806 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.003955 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.004106 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.004106 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.004373 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.004522 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.004672 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.004814 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.004963 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.005106 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.005258 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.005410 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.005560 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.005710 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.005858 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.006009 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.006151 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.006306 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.006467 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.006615 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.006768 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.006918 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.007059 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.007215 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.007374 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.007524 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.007832 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.007993 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.008136 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.008292 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.008435 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.008584 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.008734 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.008876 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.009017 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.009171 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.009324 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.009473 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.009615 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.009763 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.009919 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.010061 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.010202 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.010349 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.010549 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.010697 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.010847 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.010989 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.011139 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.011287 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.011431 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.011636 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.012288 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.012494 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.012644 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.012969 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.013130 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.013287 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.013438 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.013581 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.013723 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.013875 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.014019 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.014168 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.014424 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.014609 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.014780 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.014927 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.015108 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.015268 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.015437 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.015593 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.015765 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.015925 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.016081 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.016240 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.016383 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.016532 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.016703 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.016852 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.017024 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.017239 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.017390 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.017567 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.017716 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.018031 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.018196 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.018348 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.018539 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.018696 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.018849 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.019005 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.019155 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.019297 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.019438 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.019580 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.019729 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.019881 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.020034 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.020176 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.020317 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.020459 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.020607 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.020764 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.020914 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.021056 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.021206 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.021348 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.021498 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.021640 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.021828 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.021985 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.022156 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.022305 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.023056 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.023203 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.023345 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.023486 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.023646 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.023646 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.023934 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.024083 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.024238 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.024387 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.024544 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.024687 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.024835 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.024984 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.025134 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.025283 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.025435 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.025584 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.025726 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.025726 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.026003 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.026151 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.026306 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.026502 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.026670 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.026821 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.026963 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.027103 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.027312 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.027620 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.027836 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.028148 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.028310 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.028549 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.028549 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.028830 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.028971 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.029123 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.029266 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.029417 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.029560 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.029701 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.029841 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.029990 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.030139 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.030301 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.030462 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.030610 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.030753 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.030894 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.031034 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.031187 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.031329 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.031470 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.031618 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.031760 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.031911 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.032055 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.032205 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.032355 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.032506 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.032655 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.032805 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.032948 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.033089 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.033089 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.033364 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.033515 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.033670 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.033812 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.033962 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.034113 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.034264 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.034405 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.034604 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.034748 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.034889 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.035030 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.035179 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.035330 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.035473 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.035615 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.035756 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.035905 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.036057 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.036207 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.036359 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.036508 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.036651 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.036800 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.036948 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.037098 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.037239 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.037380 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.037630 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.037793 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.037976 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.038280 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.038280 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.038589 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.038733 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.038884 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.039035 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.039185 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.039336 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.039566 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.039722 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.039864 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.040018 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.040171 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.040320 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.040462 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.040611 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.040768 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.040920 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.041070 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.041219 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.041361 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.041502 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.041652 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.041802 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.041944 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.042096 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.042238 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.042379 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.042561 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.042715 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.042929 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.043086 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.043228 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.043371 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.043522 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.043665 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.043813 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.043967 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.044117 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.044269 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.044422 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.044565 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.044732 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.044888 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.045033 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.045186 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.045365 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.045522 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.045785 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.045932 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.046107 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.046558 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.046712 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.046855 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.047019 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.047168 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.047335 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.047493 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.047644 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.047786 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.047954 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.048356 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.048527 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.048692 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.048835 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.048980 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.049122 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.049264 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.049414 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.049557 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.049705 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.049848 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.049989 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.050164 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.050322 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.050522 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.050678 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.050830 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.050972 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.051123 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.051279 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.051434 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.051583 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.051734 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.051875 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.052060 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.052217 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.052379 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.052522 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.052672 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.052822 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.052994 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.053143 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.053314 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.053462 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.053634 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.053781 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.053954 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.054103 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.054274 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.054472 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.054625 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.054779 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.054929 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.055071 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.055234 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.055399 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.055543 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.055693 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.055843 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.055984 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.056155 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.056323 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.056465 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.056621 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.056774 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.056928 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.057085 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.057241 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.057471 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.057629 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.057777 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.057924 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.058071 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.058225 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.059563 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.059701 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.059798 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.059889 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.059889 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.060057 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.060154 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.060248 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.060342 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.060428 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.060574 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.060707 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.060897 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.061005 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.061221 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.061402 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.061562 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.061721 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.061872 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.062029 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.062186 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.062342 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.062566 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.062731 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.062889 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.063049 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.063204 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.063355 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.063510 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.063702 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.063862 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.064011 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.064158 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.064306 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.064507 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.064663 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.064819 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.064976 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.065136 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.065291 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.065452 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.065609 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.065764 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.065920 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.066076 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.066224 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.066384 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.066573 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.066725 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.066874 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.067041 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.067198 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.067360 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.067510 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.067657 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.067812 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.067978 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.068138 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.068295 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.068452 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.068600 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.068755 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.068903 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.069224 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.069384 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.069534 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.069682 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.069839 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.069987 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.070146 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.070146 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.070483 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.070650 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.070844 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.071007 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.071176 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.071325 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.071473 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.071621 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.071776 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.071933 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.072089 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.072238 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.072393 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.072542 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.072701 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.072859 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.073015 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.073173 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.073322 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.073470 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.073618 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.073775 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.073932 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.074753 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.074918 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.075067 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.075225 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.075382 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.075531 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.075697 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.075853 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.076001 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.076157 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.076305 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.076460 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.076616 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.076764 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.076939 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.077197 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.077367 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.077526 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.077691 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.077859 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.078017 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.078176 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.078325 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.078510 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.078666 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.078814 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.078975 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.079275 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.079434 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.079585 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 30 04:57:24.079741 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.079741 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.079741 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.080192 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.080347 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.080578 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.080908 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.081235 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.081558 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.081898 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.082222 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.082568 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.082891 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.083214 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.083536 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.083862 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.084183 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.084504 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.084831 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.085153 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.085491 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.085827 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.086147 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.086508 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.086848 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.087202 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.087529 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.087883 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.088219 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.088540 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.088861 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.089173 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 30 04:57:24.089464 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 30 04:57:24.140057 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO dbcounter [None req-bf8d57dc-b498-455d-961f-746f2fa4d909 None None] Registered counter for database nova_api Jul 30 04:57:24.151364 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO dbcounter [None req-2386b9f9-2ea8-4b98-bd32-2681a62c04b6 None None] Registered counter for database nova_api Jul 30 04:57:24.160379 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_db.sqlalchemy.engines [None req-bf8d57dc-b498-455d-961f-746f2fa4d909 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117886) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 30 04:57:24.167290 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writer thread running {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 30 04:57:24.172597 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_db.sqlalchemy.engines [None req-2386b9f9-2ea8-4b98-bd32-2681a62c04b6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117885) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 30 04:57:24.179130 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writer thread running {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 30 04:57:24.225015 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.context [None req-bf8d57dc-b498-455d-961f-746f2fa4d909 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),25ab7be4-4766-4eb8-ab18-1f848f2f4df6(cell1) {{(pid=117886) load_cells /opt/stack/nova/nova/context.py:464}} Jul 30 04:57:24.229150 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bf8d57dc-b498-455d-961f-746f2fa4d909 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:57:24.231403 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bf8d57dc-b498-455d-961f-746f2fa4d909 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:57:24.232323 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bf8d57dc-b498-455d-961f-746f2fa4d909 None None] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:57:24.234335 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bf8d57dc-b498-455d-961f-746f2fa4d909 None None] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:57:24.236319 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO dbcounter [None req-bf8d57dc-b498-455d-961f-746f2fa4d909 None None] Registered counter for database nova_cell0 Jul 30 04:57:24.236447 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.context [None req-2386b9f9-2ea8-4b98-bd32-2681a62c04b6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),25ab7be4-4766-4eb8-ab18-1f848f2f4df6(cell1) {{(pid=117885) load_cells /opt/stack/nova/nova/context.py:464}} Jul 30 04:57:24.240385 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO dbcounter [None req-bf8d57dc-b498-455d-961f-746f2fa4d909 None None] Registered counter for database nova_cell1 Jul 30 04:57:24.240552 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2386b9f9-2ea8-4b98-bd32-2681a62c04b6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:57:24.242173 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2386b9f9-2ea8-4b98-bd32-2681a62c04b6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:57:24.243097 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2386b9f9-2ea8-4b98-bd32-2681a62c04b6 None None] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:57:24.245012 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2386b9f9-2ea8-4b98-bd32-2681a62c04b6 None None] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:57:24.247624 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO dbcounter [None req-2386b9f9-2ea8-4b98-bd32-2681a62c04b6 None None] Registered counter for database nova_cell0 Jul 30 04:57:24.248709 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_db.sqlalchemy.engines [None req-bf8d57dc-b498-455d-961f-746f2fa4d909 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117886) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 30 04:57:24.250493 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_db.sqlalchemy.engines [None req-bf8d57dc-b498-455d-961f-746f2fa4d909 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117886) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 30 04:57:24.251831 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO dbcounter [None req-2386b9f9-2ea8-4b98-bd32-2681a62c04b6 None None] Registered counter for database nova_cell1 Jul 30 04:57:24.257429 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writer thread running {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 30 04:57:24.257774 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writer thread running {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 30 04:57:24.260799 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_db.sqlalchemy.engines [None req-2386b9f9-2ea8-4b98-bd32-2681a62c04b6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117885) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 30 04:57:24.262757 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_db.sqlalchemy.engines [None req-2386b9f9-2ea8-4b98-bd32-2681a62c04b6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117885) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 30 04:57:24.267836 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writer thread running {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 30 04:57:24.403934 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO dbcounter [None req-bf8d57dc-b498-455d-961f-746f2fa4d909 None None] Registered counter for database nova_cell0 Jul 30 04:57:24.412853 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_db.sqlalchemy.engines [None req-bf8d57dc-b498-455d-961f-746f2fa4d909 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117886) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 30 04:57:24.413059 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writer thread running {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 30 04:57:24.415587 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writer thread running {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 30 04:57:24.422133 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO dbcounter [None req-2386b9f9-2ea8-4b98-bd32-2681a62c04b6 None None] Registered counter for database nova_cell0 Jul 30 04:57:24.430053 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_db.sqlalchemy.engines [None req-2386b9f9-2ea8-4b98-bd32-2681a62c04b6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117885) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 30 04:57:24.436839 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writer thread running {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 30 04:57:24.731790 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: WARNING keystonemiddleware.auth_token [None req-bf8d57dc-b498-455d-961f-746f2fa4d909 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 30 04:57:24.739043 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: WARNING keystonemiddleware.auth_token [None req-bf8d57dc-b498-455d-961f-746f2fa4d909 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 30 04:57:24.756492 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: WARNING keystonemiddleware.auth_token [None req-2386b9f9-2ea8-4b98-bd32-2681a62c04b6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 30 04:57:24.764402 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: WARNING keystonemiddleware.auth_token [None req-2386b9f9-2ea8-4b98-bd32-2681a62c04b6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 30 04:57:25.085728 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: WARNING keystonemiddleware.auth_token [None req-bf8d57dc-b498-455d-961f-746f2fa4d909 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 30 04:57:25.092136 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: WARNING keystonemiddleware.auth_token [None req-bf8d57dc-b498-455d-961f-746f2fa4d909 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 30 04:57:25.097644 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5600c35a19c0 pid: 117886 (default app) Jul 30 04:57:25.116666 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: WARNING keystonemiddleware.auth_token [None req-2386b9f9-2ea8-4b98-bd32-2681a62c04b6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 30 04:57:25.123268 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: WARNING keystonemiddleware.auth_token [None req-2386b9f9-2ea8-4b98-bd32-2681a62c04b6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 30 04:57:25.128547 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5600c35a19c0 pid: 117885 (default app) Jul 30 04:58:06.397856 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_api:SELECT=3 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 04:58:06.399566 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell0:SELECT=3 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 04:58:06.402458 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=3 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 04:58:06.403221 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell0:SELECT=3 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 04:58:08.036334 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-400b06b8-a99c-426a-9725-bf0c5136177f tempest-VolumesGetTestJSON-1935021036 tempest-VolumesGetTestJSON-1935021036-project] Action: 'create', calling method: .version_select at 0x7f2db5825ee0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1818115246", "metadata": {"Type": "work"}}} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 04:58:09.872577 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-400b06b8-a99c-426a-9725-bf0c5136177f tempest-VolumesGetTestJSON-1935021036 tempest-VolumesGetTestJSON-1935021036-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.493412 Jul 30 04:58:09.874209 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 1/1] 10.222.0.20 () {60 vars in 1156 bytes} [Sat Jul 30 04:58:06 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3498 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 30 04:58:09.893599 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_api:SELECT=3 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 04:58:09.894533 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell0:SELECT=3 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 04:58:09.899743 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell1:SELECT=3 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 04:58:09.904944 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell0:SELECT=3 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 04:58:10.400970 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-4f173866-037c-4e04-879a-7af8ba6df284 tempest-VolumesGetTestJSON-1935021036 tempest-VolumesGetTestJSON-1935021036-project] Calling method '.version_select at 0x7f2db5899b80>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:58:11.756245 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-4f173866-037c-4e04-879a-7af8ba6df284 tempest-VolumesGetTestJSON-1935021036 tempest-VolumesGetTestJSON-1935021036-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/3fdbd65a-9eb4-4843-9072-1d96cfddef4b" status: 200 len: 354 microversion: 2.1 time: 1.870037 Jul 30 04:58:11.772610 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 1/2] 10.222.0.20 () {58 vars in 1245 bytes} [Sat Jul 30 04:58:09 2022] GET /compute/v2.1/os-volumes/3fdbd65a-9eb4-4843-9072-1d96cfddef4b => generated 354 bytes in 1889 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 04:58:11.778094 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-e01aaa7a-3c1d-4630-b059-61e465dd9a10 tempest-VolumesGetTestJSON-1935021036 tempest-VolumesGetTestJSON-1935021036-project] Calling method '.version_select at 0x7f2db56a8d30>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:58:12.130478 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-e01aaa7a-3c1d-4630-b059-61e465dd9a10 tempest-VolumesGetTestJSON-1935021036 tempest-VolumesGetTestJSON-1935021036-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/3fdbd65a-9eb4-4843-9072-1d96cfddef4b" status: 200 len: 354 microversion: 2.1 time: 0.360788 Jul 30 04:58:12.148719 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 2/3] 10.222.0.20 () {58 vars in 1245 bytes} [Sat Jul 30 04:58:11 2022] GET /compute/v2.1/os-volumes/3fdbd65a-9eb4-4843-9072-1d96cfddef4b => generated 354 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 04:58:12.161842 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-3b2ad0ea-a583-4474-aa28-78070dc6d307 tempest-VolumesGetTestJSON-1935021036 tempest-VolumesGetTestJSON-1935021036-project] Calling method '.version_select at 0x7f2db56e1d30>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:58:12.368321 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-3b2ad0ea-a583-4474-aa28-78070dc6d307 tempest-VolumesGetTestJSON-1935021036 tempest-VolumesGetTestJSON-1935021036-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/3fdbd65a-9eb4-4843-9072-1d96cfddef4b" status: 202 len: 0 microversion: 2.1 time: 0.216321 Jul 30 04:58:12.379423 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-5e1ef077-725d-4bd3-b0a0-9603e954671d tempest-VolumesGetTestJSON-1935021036 tempest-VolumesGetTestJSON-1935021036-project] Calling method '.version_select at 0x7f2db56b9430>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:58:12.379607 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 2/4] 10.222.0.20 () {58 vars in 1248 bytes} [Sat Jul 30 04:58:12 2022] DELETE /compute/v2.1/os-volumes/3fdbd65a-9eb4-4843-9072-1d96cfddef4b => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 04:58:12.601658 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-5e1ef077-725d-4bd3-b0a0-9603e954671d tempest-VolumesGetTestJSON-1935021036 tempest-VolumesGetTestJSON-1935021036-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/3fdbd65a-9eb4-4843-9072-1d96cfddef4b" status: 200 len: 353 microversion: 2.1 time: 0.227511 Jul 30 04:58:12.609879 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 3/5] 10.222.0.20 () {58 vars in 1245 bytes} [Sat Jul 30 04:58:12 2022] GET /compute/v2.1/os-volumes/3fdbd65a-9eb4-4843-9072-1d96cfddef4b => generated 353 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 04:58:13.616480 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-33af0bf1-3aa8-422b-ac76-bd81f2d29bd6 tempest-VolumesGetTestJSON-1935021036 tempest-VolumesGetTestJSON-1935021036-project] Calling method '.version_select at 0x7f2db569a430>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:58:13.677151 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.wsgi [None req-33af0bf1-3aa8-422b-ac76-bd81f2d29bd6 tempest-VolumesGetTestJSON-1935021036 tempest-VolumesGetTestJSON-1935021036-project] HTTP exception thrown: Volume 3fdbd65a-9eb4-4843-9072-1d96cfddef4b could not be found. Jul 30 04:58:13.682300 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-33af0bf1-3aa8-422b-ac76-bd81f2d29bd6 tempest-VolumesGetTestJSON-1935021036 tempest-VolumesGetTestJSON-1935021036-project] Request method failure captured: Jul 30 04:58:13.682300 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: request: GET /compute/v2.1/os-volumes/3fdbd65a-9eb4-4843-9072-1d96cfddef4b HTTP/1.1 Jul 30 04:58:13.682300 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Accept: application/json Jul 30 04:58:13.682300 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Accept-Encoding: identity Jul 30 04:58:13.682300 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Connection: close Jul 30 04:58:13.682300 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Content-Length: 0 Jul 30 04:58:13.682300 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Content-Type: application/json Jul 30 04:58:13.682300 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Host: 10.222.0.20 Jul 30 04:58:13.682300 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Openstack-System-Scope: None Jul 30 04:58:13.682300 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: User-Agent: python-urllib3/1.26.10 Jul 30 04:58:13.682300 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Auth-Token: gAAAAABi5LpeiwrdX_IuLDtocGTWnBrdM1wJ2pXgOR2AfanF8WeWJ4ZuAIsmz_uI8hSsbLVBhfoxS7ZgDsBG4hGVB8Atm_0P3TQzbGsO8V7AbG8e3TMoSWTDup2ih_WShgfheC6RWSWwQeYR2HB8ZluwKy3urDuaRmo_NrQkT9ObpEhobLS4_7k Jul 30 04:58:13.682300 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Domain-Id: None Jul 30 04:58:13.682300 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Domain-Name: None Jul 30 04:58:13.682300 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Identity-Status: Confirmed Jul 30 04:58:13.682300 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Is-Admin-Project: True Jul 30 04:58:13.682300 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Domain-Id: default Jul 30 04:58:13.682300 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Domain-Name: Default Jul 30 04:58:13.682300 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Id: 922209a39e114d2dbd25c771d269631e Jul 30 04:58:13.682300 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Name: tempest-VolumesGetTestJSON-1935021036 Jul 30 04:58:13.682300 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Role: member,reader Jul 30 04:58:13.682300 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Roles: member,reader Jul 30 04:58:13.683641 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/922209a39e114d2dbd25c771d269631e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/922209a39e114d2dbd25c771d269631e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_922209a39e114d2dbd25c771d269631e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/922209a39e114d2dbd25c771d269631e"}]}] Jul 30 04:58:13.683641 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Tenant: tempest-VolumesGetTestJSON-1935021036 Jul 30 04:58:13.683641 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Tenant-Id: 922209a39e114d2dbd25c771d269631e Jul 30 04:58:13.683641 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Tenant-Name: tempest-VolumesGetTestJSON-1935021036 Jul 30 04:58:13.683641 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User: tempest-VolumesGetTestJSON-1935021036-project Jul 30 04:58:13.683641 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Domain-Id: default Jul 30 04:58:13.683641 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Domain-Name: Default Jul 30 04:58:13.683641 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Id: ad49f82a91914d978f3cc15e1b7e0c29 Jul 30 04:58:13.683641 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Name: tempest-VolumesGetTestJSON-1935021036-project Jul 30 04:58:13.683641 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: method: Jul 30 04:58:13.683641 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: exception: Volume 3fdbd65a-9eb4-4843-9072-1d96cfddef4b could not be found. Jul 30 04:58:13.683641 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: action_args: {'id': '3fdbd65a-9eb4-4843-9072-1d96cfddef4b'} Jul 30 04:58:13.683641 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 04:58:13.684712 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 04:58:13.684712 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 30 04:58:13.684712 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 30 04:58:13.684712 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 30 04:58:13.684712 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 30 04:58:13.684712 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 30 04:58:13.684712 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 30 04:58:13.684712 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 30 04:58:13.684712 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 30 04:58:13.684712 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 30 04:58:13.684712 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 30 04:58:13.684712 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 30 04:58:13.684712 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 30 04:58:13.684712 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 30 04:58:13.684712 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 30 04:58:13.684712 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3fdbd65a-9eb4-4843-9072-1d96cfddef4b could not be found. (HTTP 404) (Request-ID: req-44abc7d5-6c2a-4edd-aaa7-ee8fca0b4198) Jul 30 04:58:13.684712 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 04:58:13.684712 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 04:58:13.684712 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 04:58:13.685893 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 04:58:13.685893 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 30 04:58:13.685893 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 30 04:58:13.685893 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 30 04:58:13.685893 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 30 04:58:13.685893 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 30 04:58:13.685893 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 30 04:58:13.685893 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 30 04:58:13.685893 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 30 04:58:13.685893 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 30 04:58:13.685893 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 30 04:58:13.685893 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 30 04:58:13.685893 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 30 04:58:13.685893 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 30 04:58:13.685893 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 30 04:58:13.685893 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 30 04:58:13.685893 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 30 04:58:13.685893 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 30 04:58:13.685893 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 30 04:58:13.686916 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 30 04:58:13.686916 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 30 04:58:13.686916 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 30 04:58:13.686916 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 30 04:58:13.686916 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3fdbd65a-9eb4-4843-9072-1d96cfddef4b could not be found. Jul 30 04:58:13.686916 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 04:58:13.686916 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 04:58:13.686916 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 04:58:13.686916 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 04:58:13.686916 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 04:58:13.686916 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 04:58:13.686916 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 04:58:13.686916 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 04:58:13.686916 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 04:58:13.686916 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 04:58:13.686916 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 04:58:13.686916 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 04:58:13.686916 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 30 04:58:13.686916 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 04:58:13.687899 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3fdbd65a-9eb4-4843-9072-1d96cfddef4b could not be found. Jul 30 04:58:13.687899 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 04:58:13.687899 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 04:58:13.687899 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 04:58:13.687899 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 04:58:13.687899 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 04:58:13.687899 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 04:58:13.687899 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 04:58:13.687899 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 04:58:13.687899 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3fdbd65a-9eb4-4843-9072-1d96cfddef4b could not be found. Jul 30 04:58:13.687899 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 04:58:13.687899 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-33af0bf1-3aa8-422b-ac76-bd81f2d29bd6 tempest-VolumesGetTestJSON-1935021036 tempest-VolumesGetTestJSON-1935021036-project] Returning 404 to user: Volume 3fdbd65a-9eb4-4843-9072-1d96cfddef4b could not be found. {{(pid=117885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 04:58:13.687899 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-33af0bf1-3aa8-422b-ac76-bd81f2d29bd6 tempest-VolumesGetTestJSON-1935021036 tempest-VolumesGetTestJSON-1935021036-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/3fdbd65a-9eb4-4843-9072-1d96cfddef4b" status: 404 len: 109 microversion: 2.1 time: 0.073657 Jul 30 04:58:13.689128 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 3/6] 10.222.0.20 () {58 vars in 1245 bytes} [Sat Jul 30 04:58:13 2022] GET /compute/v2.1/os-volumes/3fdbd65a-9eb4-4843-9072-1d96cfddef4b => generated 109 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 04:58:21.353557 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-869764b8-c2b6-4705-9889-10843e73eaa9 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Action: 'create', calling method: .version_select at 0x7f2db56b9a60>, body: {"keypair": {"name": "tempest-keypair-1945790699", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBENMDW/uu6fBBR8caulvzxXsWfm47a28y2DRSIdqA8jOevfMzCqU+JFFyZCo+57z3Mw6TW9MqEeNH/3M9Lhy8KlHlX/4ZfUaHDdLxGTQHmmo4nR3UOnugAZgVDsk/rGFuA=="}} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 04:58:21.542606 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.quota [None req-869764b8-c2b6-4705-9889-10843e73eaa9 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Getting quotas for project bc6f8afc1abf427f92c44fdc55994b18. Resources: {'key_pairs'} {{(pid=117886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 04:58:21.574012 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.quota [None req-869764b8-c2b6-4705-9889-10843e73eaa9 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Getting quotas for user d3a56c6d44b74429a6616cdfc2869b71 and project bc6f8afc1abf427f92c44fdc55994b18. Resources: {'key_pairs'} {{(pid=117886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 04:58:21.732654 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-869764b8-c2b6-4705-9889-10843e73eaa9 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.161889 Jul 30 04:58:21.734806 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-d49200f9-8336-4729-91e8-c8a11af6d49b tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Action: 'create', calling method: .version_select at 0x7f2db5685430>, body: {"keypair": {"name": "tempest-keypair-2105500540", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIM8EQyStKI23j1ZRhndFFfEKM+pzqhLl12iOGmLRu8tkaENht+wFvz+Xg6LuysRwHvSun0Lez/HVsn0Arkzt4Nj+7QxwAEzlvhdEht7LR9TZUbxwLPzNrGyY/4QIwKiiw=="}} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 04:58:21.735447 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 4/7] 10.222.0.20 () {62 vars in 1200 bytes} [Sat Jul 30 04:58:20 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1165 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 30 04:58:21.874014 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.quota [None req-d49200f9-8336-4729-91e8-c8a11af6d49b tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Getting quotas for project e01500cb03c74d1082090cd1c1836169. Resources: {'key_pairs'} {{(pid=117885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 04:58:21.895907 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.quota [None req-d49200f9-8336-4729-91e8-c8a11af6d49b tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Getting quotas for user a8abb58f9c274e568d2d0fe3d4df11de and project e01500cb03c74d1082090cd1c1836169. Resources: {'key_pairs'} {{(pid=117885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 04:58:22.038919 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-d49200f9-8336-4729-91e8-c8a11af6d49b tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.180882 Jul 30 04:58:22.039734 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 4/8] 10.222.0.20 () {60 vars in 1159 bytes} [Sat Jul 30 04:58:20 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 04:58:23.187697 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-1ffa7326-3d44-4297-87a2-bf13be8700c6 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1315540142", "imageRef": "d6a9c8e1-ecb9-4603-bb88-2b0d46ac2387", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 04:58:23.448280 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.network.neutron [None req-1ffa7326-3d44-4297-87a2-bf13be8700c6 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] validate_networks() for [('cf976b2f-0ebc-4e5a-b101-0355f31913b1', None, None, None, None, None)] {{(pid=117886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 04:58:23.700450 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-9f09f451-70f2-49fb-9ac4-c946079521b9 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1356333612", "imageRef": "d6a9c8e1-ecb9-4603-bb88-2b0d46ac2387", "flavorRef": "452", "networks": [{"uuid": "97e9be64-b56d-4d78-b9ab-2ad28b14b15e"}]}} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 04:58:23.931419 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.network.neutron [None req-9f09f451-70f2-49fb-9ac4-c946079521b9 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] validate_networks() for [('97e9be64-b56d-4d78-b9ab-2ad28b14b15e', None, None, None, None, None)] {{(pid=117885) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 04:58:25.742841 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-1ffa7326-3d44-4297-87a2-bf13be8700c6 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Flavor limits 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 04:58:25.742841 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-1ffa7326-3d44-4297-87a2-bf13be8700c6 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Image limits 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 04:58:25.742841 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-1ffa7326-3d44-4297-87a2-bf13be8700c6 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Flavor pref 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 04:58:25.742841 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-1ffa7326-3d44-4297-87a2-bf13be8700c6 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Image pref 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 04:58:25.742841 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-1ffa7326-3d44-4297-87a2-bf13be8700c6 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 04:58:25.753240 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1ffa7326-3d44-4297-87a2-bf13be8700c6 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:25.753847 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1ffa7326-3d44-4297-87a2-bf13be8700c6 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:25.757261 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1ffa7326-3d44-4297-87a2-bf13be8700c6 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:25.757851 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1ffa7326-3d44-4297-87a2-bf13be8700c6 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:25.832363 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.quota [None req-1ffa7326-3d44-4297-87a2-bf13be8700c6 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Getting quotas for project decb0bd64582440590890900e594b79e. Resources: {'ram', 'cores', 'instances'} {{(pid=117886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 04:58:25.846313 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.quota [None req-1ffa7326-3d44-4297-87a2-bf13be8700c6 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Getting quotas for user 25db6f7402ae4a14a04fab0a9915ab77 and project decb0bd64582440590890900e594b79e. Resources: {'ram', 'cores', 'instances'} {{(pid=117886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 04:58:25.881085 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-1ffa7326-3d44-4297-87a2-bf13be8700c6 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Going to run 1 instances... {{(pid=117886) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 04:58:25.886379 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-1ffa7326-3d44-4297-87a2-bf13be8700c6 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: cc0c06a0-156a-4cee-8ff7-92ab582bc4a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d6a9c8e1-ecb9-4603-bb88-2b0d46ac2387',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 04:58:26.083049 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-1ffa7326-3d44-4297-87a2-bf13be8700c6 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.143189 Jul 30 04:58:26.084522 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 5/9] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Jul 30 04:58:22 2022] POST /compute/v2.1/servers => generated 383 bytes in 3152 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 04:58:26.097371 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-00cfa82e-dce1-4eb9-a41c-b636edd79075 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:58:26.098182 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-00cfa82e-dce1-4eb9-a41c-b636edd79075 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: cc0c06a0-156a-4cee-8ff7-92ab582bc4a1] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:58:26.742504 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-00cfa82e-dce1-4eb9-a41c-b636edd79075 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:26.798949 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-00cfa82e-dce1-4eb9-a41c-b636edd79075 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0c06a0-156a-4cee-8ff7-92ab582bc4a1" status: 200 len: 1222 microversion: 2.1 time: 0.705376 Jul 30 04:58:26.801547 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 6/10] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:58:26 2022] GET /compute/v2.1/servers/cc0c06a0-156a-4cee-8ff7-92ab582bc4a1 => generated 1222 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:58:26.821686 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-9f09f451-70f2-49fb-9ac4-c946079521b9 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Flavor limits 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 04:58:26.822901 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-9f09f451-70f2-49fb-9ac4-c946079521b9 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Image limits 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 04:58:26.823522 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-9f09f451-70f2-49fb-9ac4-c946079521b9 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Flavor pref 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 04:58:26.824532 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-9f09f451-70f2-49fb-9ac4-c946079521b9 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Image pref 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 04:58:26.825067 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-9f09f451-70f2-49fb-9ac4-c946079521b9 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 04:58:26.844350 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9f09f451-70f2-49fb-9ac4-c946079521b9 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:26.846241 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9f09f451-70f2-49fb-9ac4-c946079521b9 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:26.848659 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9f09f451-70f2-49fb-9ac4-c946079521b9 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:26.850398 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9f09f451-70f2-49fb-9ac4-c946079521b9 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:26.941718 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.quota [None req-9f09f451-70f2-49fb-9ac4-c946079521b9 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Getting quotas for project ef5fe5ac675540c0930bd7bab0d8b27f. Resources: {'ram', 'cores', 'instances'} {{(pid=117885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 04:58:26.958480 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.quota [None req-9f09f451-70f2-49fb-9ac4-c946079521b9 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Getting quotas for user 691a9c5e4d534dcc9c26f8cf88cd7fb5 and project ef5fe5ac675540c0930bd7bab0d8b27f. Resources: {'ram', 'cores', 'instances'} {{(pid=117885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 04:58:27.011475 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-9f09f451-70f2-49fb-9ac4-c946079521b9 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Going to run 1 instances... {{(pid=117885) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 04:58:27.017875 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-9f09f451-70f2-49fb-9ac4-c946079521b9 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] [instance: 5348eee1-b615-4ef5-a4db-5deec1276724] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d6a9c8e1-ecb9-4603-bb88-2b0d46ac2387',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 04:58:27.174639 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-88820f52-01d7-4181-b2a9-b3a4c2d5b424 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1559965290", "imageRef": "d6a9c8e1-ecb9-4603-bb88-2b0d46ac2387", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 04:58:27.253266 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-9f09f451-70f2-49fb-9ac4-c946079521b9 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.246825 Jul 30 04:58:27.259774 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 5/11] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Jul 30 04:58:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 4254 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 04:58:27.280031 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-95858146-020b-4b4a-9d06-cb78eba8d159 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:58:27.290405 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-95858146-020b-4b4a-9d06-cb78eba8d159 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] [instance: 5348eee1-b615-4ef5-a4db-5deec1276724] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:58:27.395686 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.network.neutron [None req-88820f52-01d7-4181-b2a9-b3a4c2d5b424 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] validate_networks() for [('cf976b2f-0ebc-4e5a-b101-0355f31913b1', None, None, None, None, None)] {{(pid=117886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 04:58:27.770956 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-95858146-020b-4b4a-9d06-cb78eba8d159 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691a9c5e4d534dcc9c26f8cf88cd7fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5fe5ac675540c0930bd7bab0d8b27f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:27.828584 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-95858146-020b-4b4a-9d06-cb78eba8d159 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] 10.222.0.20 "GET /compute/v2.1/servers/5348eee1-b615-4ef5-a4db-5deec1276724" status: 200 len: 1215 microversion: 2.1 time: 0.558181 Jul 30 04:58:27.832897 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 6/12] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:58:27 2022] GET /compute/v2.1/servers/5348eee1-b615-4ef5-a4db-5deec1276724 => generated 1215 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 04:58:28.669704 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-d21a7b32-2a77-4249-830c-8eb47ff19d73 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-431833634", "imageRef": "d6a9c8e1-ecb9-4603-bb88-2b0d46ac2387", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "afd82f39-2725-4de8-bc03-d4d225abc92e"}], "security_groups": [{"name": "tempest-securitygroup--693254762"}], "key_name": "tempest-keypair-2105500540", "user_data": "}} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 04:58:29.057681 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.network.neutron [None req-d21a7b32-2a77-4249-830c-8eb47ff19d73 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] validate_networks() for [('afd82f39-2725-4de8-bc03-d4d225abc92e', None, None, None, None, None)] {{(pid=117885) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 04:58:29.792612 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-88820f52-01d7-4181-b2a9-b3a4c2d5b424 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Flavor limits 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 04:58:29.793744 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-88820f52-01d7-4181-b2a9-b3a4c2d5b424 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Image limits 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 04:58:29.794393 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-88820f52-01d7-4181-b2a9-b3a4c2d5b424 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Flavor pref 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 04:58:29.795461 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-88820f52-01d7-4181-b2a9-b3a4c2d5b424 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Image pref 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 04:58:29.796173 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-88820f52-01d7-4181-b2a9-b3a4c2d5b424 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 04:58:29.809523 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-88820f52-01d7-4181-b2a9-b3a4c2d5b424 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:29.811122 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-88820f52-01d7-4181-b2a9-b3a4c2d5b424 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:29.812194 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-88820f52-01d7-4181-b2a9-b3a4c2d5b424 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:29.812856 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-88820f52-01d7-4181-b2a9-b3a4c2d5b424 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:29.835726 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.quota [None req-88820f52-01d7-4181-b2a9-b3a4c2d5b424 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Getting quotas for project decb0bd64582440590890900e594b79e. Resources: {'ram', 'cores', 'instances'} {{(pid=117886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 04:58:29.842026 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.quota [None req-88820f52-01d7-4181-b2a9-b3a4c2d5b424 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Getting quotas for user 25db6f7402ae4a14a04fab0a9915ab77 and project decb0bd64582440590890900e594b79e. Resources: {'ram', 'cores', 'instances'} {{(pid=117886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 04:58:29.856725 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-88820f52-01d7-4181-b2a9-b3a4c2d5b424 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Going to run 1 instances... {{(pid=117886) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 04:58:29.860586 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-88820f52-01d7-4181-b2a9-b3a4c2d5b424 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 7b5e218d-8660-4d90-90d1-9c8e50a66a7c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d6a9c8e1-ecb9-4603-bb88-2b0d46ac2387',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 04:58:29.946174 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-88820f52-01d7-4181-b2a9-b3a4c2d5b424 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.776945 Jul 30 04:58:29.955097 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 7/13] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Jul 30 04:58:27 2022] POST /compute/v2.1/servers => generated 383 bytes in 2782 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 30 04:58:29.960621 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-79a16276-0f34-42a0-97a7-5dc9ee948e46 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:58:29.967183 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-79a16276-0f34-42a0-97a7-5dc9ee948e46 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] [instance: 5348eee1-b615-4ef5-a4db-5deec1276724] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:58:29.995948 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-79a16276-0f34-42a0-97a7-5dc9ee948e46 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:29.996983 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-79a16276-0f34-42a0-97a7-5dc9ee948e46 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:29.999262 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-79a16276-0f34-42a0-97a7-5dc9ee948e46 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:30.004037 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-79a16276-0f34-42a0-97a7-5dc9ee948e46 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:30.282689 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-79a16276-0f34-42a0-97a7-5dc9ee948e46 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691a9c5e4d534dcc9c26f8cf88cd7fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5fe5ac675540c0930bd7bab0d8b27f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:30.299957 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-d21a7b32-2a77-4249-830c-8eb47ff19d73 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Flavor limits 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 04:58:30.300523 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-d21a7b32-2a77-4249-830c-8eb47ff19d73 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Image limits 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 04:58:30.300841 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-d21a7b32-2a77-4249-830c-8eb47ff19d73 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Flavor pref 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 04:58:30.301250 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-d21a7b32-2a77-4249-830c-8eb47ff19d73 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Image pref 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 04:58:30.301813 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-d21a7b32-2a77-4249-830c-8eb47ff19d73 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 04:58:30.316471 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d21a7b32-2a77-4249-830c-8eb47ff19d73 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:30.317147 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d21a7b32-2a77-4249-830c-8eb47ff19d73 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:30.317289 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-79a16276-0f34-42a0-97a7-5dc9ee948e46 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] 10.222.0.20 "GET /compute/v2.1/servers/5348eee1-b615-4ef5-a4db-5deec1276724" status: 200 len: 1219 microversion: 2.1 time: 0.362611 Jul 30 04:58:30.318213 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d21a7b32-2a77-4249-830c-8eb47ff19d73 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:30.318830 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d21a7b32-2a77-4249-830c-8eb47ff19d73 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:30.359205 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 8/14] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:58:29 2022] GET /compute/v2.1/servers/5348eee1-b615-4ef5-a4db-5deec1276724 => generated 1219 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:58:30.370670 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.quota [None req-d21a7b32-2a77-4249-830c-8eb47ff19d73 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Getting quotas for project e01500cb03c74d1082090cd1c1836169. Resources: {'ram', 'cores', 'instances'} {{(pid=117885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 04:58:30.377231 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.quota [None req-d21a7b32-2a77-4249-830c-8eb47ff19d73 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Getting quotas for user a8abb58f9c274e568d2d0fe3d4df11de and project e01500cb03c74d1082090cd1c1836169. Resources: {'ram', 'cores', 'instances'} {{(pid=117885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 04:58:30.377389 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-deaae963-c89a-429d-8387-e6c542cde2ba tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:58:30.378554 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-deaae963-c89a-429d-8387-e6c542cde2ba tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 7b5e218d-8660-4d90-90d1-9c8e50a66a7c] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:58:30.398589 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-d21a7b32-2a77-4249-830c-8eb47ff19d73 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Going to run 1 instances... {{(pid=117885) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 04:58:30.402055 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-d21a7b32-2a77-4249-830c-8eb47ff19d73 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: f27c16ec-7d74-4a2a-9b40-c95455fa8aff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d6a9c8e1-ecb9-4603-bb88-2b0d46ac2387',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 04:58:30.471520 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-d21a7b32-2a77-4249-830c-8eb47ff19d73 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.807895 Jul 30 04:58:30.474906 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 7/15] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Jul 30 04:58:28 2022] POST /compute/v2.1/servers => generated 401 bytes in 1812 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 04:58:30.486682 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-fce276d3-fd80-4ca8-817b-f1e8ecec6309 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-761556885", "imageRef": "d6a9c8e1-ecb9-4603-bb88-2b0d46ac2387", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fdf70601-7662-4f43-8ddd-db3bc3add8d1"}], "security_groups": [{"name": "tempest-securitygroup--2103773760"}], "key_name": "tempest-keypair-1945790699", "user_data": "}} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 04:58:30.625069 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-deaae963-c89a-429d-8387-e6c542cde2ba tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:30.643133 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-deaae963-c89a-429d-8387-e6c542cde2ba tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c" status: 200 len: 1222 microversion: 2.1 time: 0.278888 Jul 30 04:58:30.643751 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 9/16] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:58:30 2022] GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c => generated 1222 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:58:30.666546 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-a97ba854-e0ab-434c-a63e-235de9c6aee1 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:58:30.668065 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-a97ba854-e0ab-434c-a63e-235de9c6aee1 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: f27c16ec-7d74-4a2a-9b40-c95455fa8aff] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:58:30.704020 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.network.neutron [None req-fce276d3-fd80-4ca8-817b-f1e8ecec6309 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] validate_networks() for [('fdf70601-7662-4f43-8ddd-db3bc3add8d1', None, None, None, None, None)] {{(pid=117885) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 04:58:30.853948 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-a97ba854-e0ab-434c-a63e-235de9c6aee1 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8abb58f9c274e568d2d0fe3d4df11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01500cb03c74d1082090cd1c1836169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:30.862780 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-a97ba854-e0ab-434c-a63e-235de9c6aee1 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff" status: 200 len: 1241 microversion: 2.1 time: 0.200344 Jul 30 04:58:30.867251 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 10/17] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:58:30 2022] GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff => generated 1241 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:58:31.343386 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-1c829850-5e80-43f8-8044-1f9019fa5300 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:58:31.344018 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-1c829850-5e80-43f8-8044-1f9019fa5300 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] [instance: 5348eee1-b615-4ef5-a4db-5deec1276724] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:58:31.351920 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1c829850-5e80-43f8-8044-1f9019fa5300 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:31.352837 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1c829850-5e80-43f8-8044-1f9019fa5300 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:31.363343 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1c829850-5e80-43f8-8044-1f9019fa5300 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:31.364049 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1c829850-5e80-43f8-8044-1f9019fa5300 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:31.421006 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-fce276d3-fd80-4ca8-817b-f1e8ecec6309 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Flavor limits 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 04:58:31.421982 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-fce276d3-fd80-4ca8-817b-f1e8ecec6309 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Image limits 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 04:58:31.422641 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-fce276d3-fd80-4ca8-817b-f1e8ecec6309 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Flavor pref 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 04:58:31.423353 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-fce276d3-fd80-4ca8-817b-f1e8ecec6309 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Image pref 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 04:58:31.423941 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-fce276d3-fd80-4ca8-817b-f1e8ecec6309 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 04:58:31.459925 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-fce276d3-fd80-4ca8-817b-f1e8ecec6309 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:31.460398 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-fce276d3-fd80-4ca8-817b-f1e8ecec6309 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:31.461767 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-fce276d3-fd80-4ca8-817b-f1e8ecec6309 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:31.467187 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-fce276d3-fd80-4ca8-817b-f1e8ecec6309 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:31.501230 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-1c829850-5e80-43f8-8044-1f9019fa5300 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691a9c5e4d534dcc9c26f8cf88cd7fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5fe5ac675540c0930bd7bab0d8b27f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:31.511737 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-1c829850-5e80-43f8-8044-1f9019fa5300 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] 10.222.0.20 "GET /compute/v2.1/servers/5348eee1-b615-4ef5-a4db-5deec1276724" status: 200 len: 1211 microversion: 2.1 time: 0.172073 Jul 30 04:58:31.512762 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.quota [None req-fce276d3-fd80-4ca8-817b-f1e8ecec6309 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Getting quotas for project bc6f8afc1abf427f92c44fdc55994b18. Resources: {'ram', 'cores', 'instances'} {{(pid=117885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 04:58:31.521151 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.quota [None req-fce276d3-fd80-4ca8-817b-f1e8ecec6309 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Getting quotas for user d3a56c6d44b74429a6616cdfc2869b71 and project bc6f8afc1abf427f92c44fdc55994b18. Resources: {'ram', 'cores', 'instances'} {{(pid=117885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 04:58:31.523251 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 11/18] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:58:31 2022] GET /compute/v2.1/servers/5348eee1-b615-4ef5-a4db-5deec1276724 => generated 1211 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:58:31.536896 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-fce276d3-fd80-4ca8-817b-f1e8ecec6309 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Going to run 1 instances... {{(pid=117885) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 04:58:31.539244 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-fce276d3-fd80-4ca8-817b-f1e8ecec6309 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d6a9c8e1-ecb9-4603-bb88-2b0d46ac2387',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 04:58:31.638164 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-fce276d3-fd80-4ca8-817b-f1e8ecec6309 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.161784 Jul 30 04:58:31.640984 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 8/19] 10.222.0.20 () {62 vars in 1188 bytes} [Sat Jul 30 04:58:30 2022] POST /compute/v2.1/servers => generated 402 bytes in 1165 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 30 04:58:31.653040 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-c1057d12-abe8-4990-9195-da8cd67d5a23 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:58:31.654054 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-c1057d12-abe8-4990-9195-da8cd67d5a23 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:58:31.666255 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-c0f272eb-c486-4e9e-afa2-a5578bbad684 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:58:31.667056 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-c0f272eb-c486-4e9e-afa2-a5578bbad684 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 7b5e218d-8660-4d90-90d1-9c8e50a66a7c] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:58:31.682492 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c0f272eb-c486-4e9e-afa2-a5578bbad684 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:31.686265 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c0f272eb-c486-4e9e-afa2-a5578bbad684 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:31.687366 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c0f272eb-c486-4e9e-afa2-a5578bbad684 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:31.689087 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c0f272eb-c486-4e9e-afa2-a5578bbad684 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:31.785935 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-c1057d12-abe8-4990-9195-da8cd67d5a23 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:31.796883 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-c1057d12-abe8-4990-9195-da8cd67d5a23 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:31.804017 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-c1057d12-abe8-4990-9195-da8cd67d5a23 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:31.806910 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-c1057d12-abe8-4990-9195-da8cd67d5a23 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1281 microversion: 2.20 time: 0.159236 Jul 30 04:58:31.830195 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 12/20] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 04:58:31 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1281 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 04:58:31.893144 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-74a3fbe0-4f46-4c1a-a0f3-25c3df830839 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:58:31.898787 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-74a3fbe0-4f46-4c1a-a0f3-25c3df830839 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: f27c16ec-7d74-4a2a-9b40-c95455fa8aff] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:58:31.928798 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-74a3fbe0-4f46-4c1a-a0f3-25c3df830839 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:31.929258 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-74a3fbe0-4f46-4c1a-a0f3-25c3df830839 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:31.930686 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-74a3fbe0-4f46-4c1a-a0f3-25c3df830839 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:31.931140 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-74a3fbe0-4f46-4c1a-a0f3-25c3df830839 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:32.063034 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-c0f272eb-c486-4e9e-afa2-a5578bbad684 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:32.077349 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-c0f272eb-c486-4e9e-afa2-a5578bbad684 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c" status: 200 len: 1218 microversion: 2.1 time: 0.416591 Jul 30 04:58:32.077936 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 9/21] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:58:31 2022] GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c => generated 1218 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 04:58:32.139503 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-74a3fbe0-4f46-4c1a-a0f3-25c3df830839 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8abb58f9c274e568d2d0fe3d4df11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01500cb03c74d1082090cd1c1836169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:32.146822 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-74a3fbe0-4f46-4c1a-a0f3-25c3df830839 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff" status: 200 len: 1245 microversion: 2.1 time: 0.262069 Jul 30 04:58:32.147401 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 13/22] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:58:31 2022] GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff => generated 1245 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:58:32.538165 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-32226a35-980d-43ac-90bd-8819b1a58d82 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:58:32.538883 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-32226a35-980d-43ac-90bd-8819b1a58d82 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] [instance: 5348eee1-b615-4ef5-a4db-5deec1276724] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:58:32.550858 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-32226a35-980d-43ac-90bd-8819b1a58d82 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:32.552020 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-32226a35-980d-43ac-90bd-8819b1a58d82 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:32.553274 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-32226a35-980d-43ac-90bd-8819b1a58d82 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:32.553976 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-32226a35-980d-43ac-90bd-8819b1a58d82 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:32.637087 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-32226a35-980d-43ac-90bd-8819b1a58d82 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691a9c5e4d534dcc9c26f8cf88cd7fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5fe5ac675540c0930bd7bab0d8b27f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:32.651269 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-32226a35-980d-43ac-90bd-8819b1a58d82 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] 10.222.0.20 "GET /compute/v2.1/servers/5348eee1-b615-4ef5-a4db-5deec1276724" status: 200 len: 1211 microversion: 2.1 time: 0.116802 Jul 30 04:58:32.652070 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 10/23] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:58:32 2022] GET /compute/v2.1/servers/5348eee1-b615-4ef5-a4db-5deec1276724 => generated 1211 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:58:32.833177 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-6e778e87-a8ba-4c40-aa07-ce61dd530de4 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:58:32.833704 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-6e778e87-a8ba-4c40-aa07-ce61dd530de4 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:58:32.845102 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6e778e87-a8ba-4c40-aa07-ce61dd530de4 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:32.845561 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6e778e87-a8ba-4c40-aa07-ce61dd530de4 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:32.846346 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6e778e87-a8ba-4c40-aa07-ce61dd530de4 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:32.846817 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6e778e87-a8ba-4c40-aa07-ce61dd530de4 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:33.016376 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-6e778e87-a8ba-4c40-aa07-ce61dd530de4 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:33.026119 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-6e778e87-a8ba-4c40-aa07-ce61dd530de4 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:33.028718 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-6e778e87-a8ba-4c40-aa07-ce61dd530de4 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:33.030104 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-6e778e87-a8ba-4c40-aa07-ce61dd530de4 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1285 microversion: 2.20 time: 0.200831 Jul 30 04:58:33.043008 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 14/24] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 04:58:32 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1285 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 04:58:33.099662 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-8d256f34-190d-4d70-829b-f30bd6d9dbfa tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:58:33.100501 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-8d256f34-190d-4d70-829b-f30bd6d9dbfa tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 7b5e218d-8660-4d90-90d1-9c8e50a66a7c] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:58:33.109647 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8d256f34-190d-4d70-829b-f30bd6d9dbfa tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:33.110326 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8d256f34-190d-4d70-829b-f30bd6d9dbfa tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:33.111327 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8d256f34-190d-4d70-829b-f30bd6d9dbfa tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:33.111907 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8d256f34-190d-4d70-829b-f30bd6d9dbfa tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:33.173803 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-96b02c19-932f-4239-889d-b349a477a8bc tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:58:33.174425 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-96b02c19-932f-4239-889d-b349a477a8bc tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: f27c16ec-7d74-4a2a-9b40-c95455fa8aff] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:58:33.182948 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-96b02c19-932f-4239-889d-b349a477a8bc tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:33.183404 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-96b02c19-932f-4239-889d-b349a477a8bc tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:33.184208 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-96b02c19-932f-4239-889d-b349a477a8bc tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:33.184807 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-96b02c19-932f-4239-889d-b349a477a8bc tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:33.238058 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-8d256f34-190d-4d70-829b-f30bd6d9dbfa tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:33.253929 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-8d256f34-190d-4d70-829b-f30bd6d9dbfa tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c" status: 200 len: 1218 microversion: 2.1 time: 0.158399 Jul 30 04:58:33.254942 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 11/25] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:58:33 2022] GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c => generated 1218 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:58:33.279199 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-96b02c19-932f-4239-889d-b349a477a8bc tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8abb58f9c274e568d2d0fe3d4df11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01500cb03c74d1082090cd1c1836169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:33.287598 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-96b02c19-932f-4239-889d-b349a477a8bc tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff" status: 200 len: 1245 microversion: 2.1 time: 0.119269 Jul 30 04:58:33.288177 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 15/26] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:58:33 2022] GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff => generated 1245 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:58:33.675998 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-df75782d-1257-4c2c-bffc-1e57c8b6d813 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:58:33.677487 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-df75782d-1257-4c2c-bffc-1e57c8b6d813 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] [instance: 5348eee1-b615-4ef5-a4db-5deec1276724] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:58:33.690076 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-df75782d-1257-4c2c-bffc-1e57c8b6d813 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:33.690960 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-df75782d-1257-4c2c-bffc-1e57c8b6d813 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:33.693715 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-df75782d-1257-4c2c-bffc-1e57c8b6d813 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:33.699388 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-df75782d-1257-4c2c-bffc-1e57c8b6d813 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:34.048183 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-df75782d-1257-4c2c-bffc-1e57c8b6d813 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691a9c5e4d534dcc9c26f8cf88cd7fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5fe5ac675540c0930bd7bab0d8b27f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:34.054769 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-af3dd146-07c0-430b-b519-678336842c84 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:58:34.056601 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-af3dd146-07c0-430b-b519-678336842c84 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:58:34.057842 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-df75782d-1257-4c2c-bffc-1e57c8b6d813 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] 10.222.0.20 "GET /compute/v2.1/servers/5348eee1-b615-4ef5-a4db-5deec1276724" status: 200 len: 1211 microversion: 2.1 time: 0.388002 Jul 30 04:58:34.074723 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-af3dd146-07c0-430b-b519-678336842c84 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:34.074723 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-af3dd146-07c0-430b-b519-678336842c84 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:34.074723 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-af3dd146-07c0-430b-b519-678336842c84 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:34.075043 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-af3dd146-07c0-430b-b519-678336842c84 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:34.075564 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 12/27] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:58:33 2022] GET /compute/v2.1/servers/5348eee1-b615-4ef5-a4db-5deec1276724 => generated 1211 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:58:34.195006 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-af3dd146-07c0-430b-b519-678336842c84 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:34.206052 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-af3dd146-07c0-430b-b519-678336842c84 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:34.207895 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-af3dd146-07c0-430b-b519-678336842c84 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:34.209723 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-af3dd146-07c0-430b-b519-678336842c84 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1333 microversion: 2.20 time: 0.159772 Jul 30 04:58:34.210573 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 16/28] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 04:58:34 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1333 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 04:58:34.277748 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-f5c66df7-753f-4ae8-8296-43897d3e4340 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:58:34.278648 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-f5c66df7-753f-4ae8-8296-43897d3e4340 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 7b5e218d-8660-4d90-90d1-9c8e50a66a7c] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:58:34.285251 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f5c66df7-753f-4ae8-8296-43897d3e4340 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:34.285794 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f5c66df7-753f-4ae8-8296-43897d3e4340 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:34.286721 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f5c66df7-753f-4ae8-8296-43897d3e4340 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:34.287452 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f5c66df7-753f-4ae8-8296-43897d3e4340 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:34.314395 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-3130feb7-3589-435d-a1d3-feaec831d275 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:58:34.315175 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-3130feb7-3589-435d-a1d3-feaec831d275 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: f27c16ec-7d74-4a2a-9b40-c95455fa8aff] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:58:34.327091 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3130feb7-3589-435d-a1d3-feaec831d275 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:34.327378 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3130feb7-3589-435d-a1d3-feaec831d275 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:34.328158 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3130feb7-3589-435d-a1d3-feaec831d275 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:34.328594 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3130feb7-3589-435d-a1d3-feaec831d275 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:34.425974 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-f5c66df7-753f-4ae8-8296-43897d3e4340 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:34.433783 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-f5c66df7-753f-4ae8-8296-43897d3e4340 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c" status: 200 len: 1274 microversion: 2.1 time: 0.161909 Jul 30 04:58:34.434363 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 13/29] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:58:34 2022] GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c => generated 1274 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:58:34.447418 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-3130feb7-3589-435d-a1d3-feaec831d275 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8abb58f9c274e568d2d0fe3d4df11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01500cb03c74d1082090cd1c1836169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:34.458116 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-3130feb7-3589-435d-a1d3-feaec831d275 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff" status: 200 len: 1237 microversion: 2.1 time: 0.149581 Jul 30 04:58:34.460797 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 17/30] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:58:34 2022] GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff => generated 1237 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 04:58:35.084716 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-d0d9e3c4-c358-4389-9119-4976d00f704d tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:58:35.086267 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-d0d9e3c4-c358-4389-9119-4976d00f704d tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] [instance: 5348eee1-b615-4ef5-a4db-5deec1276724] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:58:35.098716 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d0d9e3c4-c358-4389-9119-4976d00f704d tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:35.099489 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d0d9e3c4-c358-4389-9119-4976d00f704d tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:35.103948 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d0d9e3c4-c358-4389-9119-4976d00f704d tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:35.107943 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d0d9e3c4-c358-4389-9119-4976d00f704d tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:35.232722 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-d0d9e3c4-c358-4389-9119-4976d00f704d tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691a9c5e4d534dcc9c26f8cf88cd7fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5fe5ac675540c0930bd7bab0d8b27f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:35.237233 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-f6305662-17e2-4b2f-a954-51bad134d578 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:58:35.237859 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-f6305662-17e2-4b2f-a954-51bad134d578 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:58:35.246037 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-d0d9e3c4-c358-4389-9119-4976d00f704d tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] 10.222.0.20 "GET /compute/v2.1/servers/5348eee1-b615-4ef5-a4db-5deec1276724" status: 200 len: 1267 microversion: 2.1 time: 0.167541 Jul 30 04:58:35.247054 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 14/31] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:58:35 2022] GET /compute/v2.1/servers/5348eee1-b615-4ef5-a4db-5deec1276724 => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:58:35.247335 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f6305662-17e2-4b2f-a954-51bad134d578 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:35.247798 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f6305662-17e2-4b2f-a954-51bad134d578 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:35.250755 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f6305662-17e2-4b2f-a954-51bad134d578 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:35.251216 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f6305662-17e2-4b2f-a954-51bad134d578 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:35.332282 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-f6305662-17e2-4b2f-a954-51bad134d578 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:35.342754 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-f6305662-17e2-4b2f-a954-51bad134d578 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:35.349656 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-f6305662-17e2-4b2f-a954-51bad134d578 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:35.351099 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-f6305662-17e2-4b2f-a954-51bad134d578 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1333 microversion: 2.20 time: 0.117504 Jul 30 04:58:35.353854 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 18/32] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 04:58:35 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1333 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 04:58:35.457322 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-541db253-1aa3-4862-b06b-9362cf33c9c1 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:58:35.458190 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-541db253-1aa3-4862-b06b-9362cf33c9c1 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 7b5e218d-8660-4d90-90d1-9c8e50a66a7c] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:58:35.470247 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-541db253-1aa3-4862-b06b-9362cf33c9c1 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:35.477238 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-541db253-1aa3-4862-b06b-9362cf33c9c1 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:35.478505 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-541db253-1aa3-4862-b06b-9362cf33c9c1 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:35.479138 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-541db253-1aa3-4862-b06b-9362cf33c9c1 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:35.487150 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-6982e703-7da8-4523-8be2-9d3d2c69c88d tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:58:35.488135 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-6982e703-7da8-4523-8be2-9d3d2c69c88d tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: f27c16ec-7d74-4a2a-9b40-c95455fa8aff] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:58:35.496241 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6982e703-7da8-4523-8be2-9d3d2c69c88d tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:35.497206 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6982e703-7da8-4523-8be2-9d3d2c69c88d tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:35.498151 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6982e703-7da8-4523-8be2-9d3d2c69c88d tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:35.498764 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6982e703-7da8-4523-8be2-9d3d2c69c88d tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:35.585614 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-6982e703-7da8-4523-8be2-9d3d2c69c88d tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8abb58f9c274e568d2d0fe3d4df11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01500cb03c74d1082090cd1c1836169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:35.595197 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-6982e703-7da8-4523-8be2-9d3d2c69c88d tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff" status: 200 len: 1237 microversion: 2.1 time: 0.111926 Jul 30 04:58:35.596967 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 19/33] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:58:35 2022] GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff => generated 1237 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:58:35.623452 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-541db253-1aa3-4862-b06b-9362cf33c9c1 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:35.639185 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-541db253-1aa3-4862-b06b-9362cf33c9c1 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c" status: 200 len: 1274 microversion: 2.1 time: 0.186775 Jul 30 04:58:35.639775 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 15/34] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:58:35 2022] GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c => generated 1274 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:58:36.267790 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-6343027d-5a68-4c95-8607-d79622b04cd6 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:58:36.274796 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-6343027d-5a68-4c95-8607-d79622b04cd6 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] [instance: 5348eee1-b615-4ef5-a4db-5deec1276724] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:58:36.291985 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6343027d-5a68-4c95-8607-d79622b04cd6 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:36.292809 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6343027d-5a68-4c95-8607-d79622b04cd6 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:36.293612 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6343027d-5a68-4c95-8607-d79622b04cd6 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:36.294049 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6343027d-5a68-4c95-8607-d79622b04cd6 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:36.383764 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-856f8fda-5b0c-45ed-8479-fc453fd335ea tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:58:36.384573 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-856f8fda-5b0c-45ed-8479-fc453fd335ea tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:58:36.394328 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-856f8fda-5b0c-45ed-8479-fc453fd335ea tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:36.405659 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-856f8fda-5b0c-45ed-8479-fc453fd335ea tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:36.406857 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-856f8fda-5b0c-45ed-8479-fc453fd335ea tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:36.407455 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-856f8fda-5b0c-45ed-8479-fc453fd335ea tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:36.411647 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-6343027d-5a68-4c95-8607-d79622b04cd6 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691a9c5e4d534dcc9c26f8cf88cd7fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5fe5ac675540c0930bd7bab0d8b27f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:36.425173 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-6343027d-5a68-4c95-8607-d79622b04cd6 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] 10.222.0.20 "GET /compute/v2.1/servers/5348eee1-b615-4ef5-a4db-5deec1276724" status: 200 len: 1267 microversion: 2.1 time: 0.160592 Jul 30 04:58:36.427652 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 20/35] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:58:36 2022] GET /compute/v2.1/servers/5348eee1-b615-4ef5-a4db-5deec1276724 => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:58:36.487286 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-856f8fda-5b0c-45ed-8479-fc453fd335ea tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:36.498113 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-856f8fda-5b0c-45ed-8479-fc453fd335ea tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:36.499967 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-856f8fda-5b0c-45ed-8479-fc453fd335ea tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:36.501276 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-856f8fda-5b0c-45ed-8479-fc453fd335ea tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1333 microversion: 2.20 time: 0.125096 Jul 30 04:58:36.502843 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 16/36] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 04:58:36 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1333 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 04:58:36.618137 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-76bd42de-c8d8-4609-8bf6-9e32a0838bb1 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:58:36.619055 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-76bd42de-c8d8-4609-8bf6-9e32a0838bb1 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: f27c16ec-7d74-4a2a-9b40-c95455fa8aff] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:58:36.627207 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-76bd42de-c8d8-4609-8bf6-9e32a0838bb1 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:36.631565 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-76bd42de-c8d8-4609-8bf6-9e32a0838bb1 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:36.632396 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-76bd42de-c8d8-4609-8bf6-9e32a0838bb1 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:36.633432 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-76bd42de-c8d8-4609-8bf6-9e32a0838bb1 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:36.662240 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-75930171-4f29-4691-800f-bb8eb2196663 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:58:36.663160 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-75930171-4f29-4691-800f-bb8eb2196663 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 7b5e218d-8660-4d90-90d1-9c8e50a66a7c] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:58:36.671712 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-75930171-4f29-4691-800f-bb8eb2196663 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:36.672504 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-75930171-4f29-4691-800f-bb8eb2196663 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:36.673282 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-75930171-4f29-4691-800f-bb8eb2196663 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:36.673711 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-75930171-4f29-4691-800f-bb8eb2196663 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:36.721677 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-76bd42de-c8d8-4609-8bf6-9e32a0838bb1 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8abb58f9c274e568d2d0fe3d4df11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01500cb03c74d1082090cd1c1836169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:36.731593 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-76bd42de-c8d8-4609-8bf6-9e32a0838bb1 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff" status: 200 len: 1237 microversion: 2.1 time: 0.118250 Jul 30 04:58:36.743435 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 21/37] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:58:36 2022] GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff => generated 1237 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:58:36.780289 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-75930171-4f29-4691-800f-bb8eb2196663 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:36.788567 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-75930171-4f29-4691-800f-bb8eb2196663 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c" status: 200 len: 1274 microversion: 2.1 time: 0.130699 Jul 30 04:58:36.790182 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 17/38] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:58:36 2022] GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c => generated 1274 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:58:37.454272 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-701f664f-2ff7-4828-8f63-217416ae87b4 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:58:37.458465 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-701f664f-2ff7-4828-8f63-217416ae87b4 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] [instance: 5348eee1-b615-4ef5-a4db-5deec1276724] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:58:37.486917 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-701f664f-2ff7-4828-8f63-217416ae87b4 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:37.488445 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-701f664f-2ff7-4828-8f63-217416ae87b4 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:37.491716 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-701f664f-2ff7-4828-8f63-217416ae87b4 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:37.505693 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-701f664f-2ff7-4828-8f63-217416ae87b4 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:37.528226 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-794c27f3-d7f1-4e92-a9e7-dec4f8e6ed6e tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:58:37.528877 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-794c27f3-d7f1-4e92-a9e7-dec4f8e6ed6e tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:58:37.549967 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-794c27f3-d7f1-4e92-a9e7-dec4f8e6ed6e tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:37.554170 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-794c27f3-d7f1-4e92-a9e7-dec4f8e6ed6e tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:37.556112 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-794c27f3-d7f1-4e92-a9e7-dec4f8e6ed6e tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:37.558406 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-794c27f3-d7f1-4e92-a9e7-dec4f8e6ed6e tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:37.885988 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-794c27f3-d7f1-4e92-a9e7-dec4f8e6ed6e tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:37.908451 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-794c27f3-d7f1-4e92-a9e7-dec4f8e6ed6e tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:37.913047 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-794c27f3-d7f1-4e92-a9e7-dec4f8e6ed6e tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:37.940240 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-794c27f3-d7f1-4e92-a9e7-dec4f8e6ed6e tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1333 microversion: 2.20 time: 0.396958 Jul 30 04:58:37.949518 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 18/39] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 04:58:37 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1333 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 04:58:37.972911 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-68a77f23-78a3-466a-8829-f5ec4c77d15d tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:58:37.980111 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-68a77f23-78a3-466a-8829-f5ec4c77d15d tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: f27c16ec-7d74-4a2a-9b40-c95455fa8aff] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:58:38.016488 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-68a77f23-78a3-466a-8829-f5ec4c77d15d tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:38.016958 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-68a77f23-78a3-466a-8829-f5ec4c77d15d tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:38.021738 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-68a77f23-78a3-466a-8829-f5ec4c77d15d tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:38.027213 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-68a77f23-78a3-466a-8829-f5ec4c77d15d tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:38.387705 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-701f664f-2ff7-4828-8f63-217416ae87b4 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691a9c5e4d534dcc9c26f8cf88cd7fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5fe5ac675540c0930bd7bab0d8b27f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:38.409157 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-701f664f-2ff7-4828-8f63-217416ae87b4 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] 10.222.0.20 "GET /compute/v2.1/servers/5348eee1-b615-4ef5-a4db-5deec1276724" status: 200 len: 1275 microversion: 2.1 time: 0.963937 Jul 30 04:58:38.412304 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 22/40] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:58:37 2022] GET /compute/v2.1/servers/5348eee1-b615-4ef5-a4db-5deec1276724 => generated 1275 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:58:38.431366 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-c6ba17c0-749a-4ee6-8c7d-0f0f040535f8 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:58:38.431996 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-c6ba17c0-749a-4ee6-8c7d-0f0f040535f8 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 7b5e218d-8660-4d90-90d1-9c8e50a66a7c] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:58:38.461605 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c6ba17c0-749a-4ee6-8c7d-0f0f040535f8 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:38.463674 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c6ba17c0-749a-4ee6-8c7d-0f0f040535f8 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:38.471498 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c6ba17c0-749a-4ee6-8c7d-0f0f040535f8 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:38.475579 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c6ba17c0-749a-4ee6-8c7d-0f0f040535f8 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:38.503986 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-68a77f23-78a3-466a-8829-f5ec4c77d15d tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8abb58f9c274e568d2d0fe3d4df11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01500cb03c74d1082090cd1c1836169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:38.513118 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-68a77f23-78a3-466a-8829-f5ec4c77d15d tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff" status: 200 len: 1301 microversion: 2.1 time: 0.562478 Jul 30 04:58:38.517066 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 19/41] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:58:37 2022] GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff => generated 1301 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:58:38.800891 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-c6ba17c0-749a-4ee6-8c7d-0f0f040535f8 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:38.816812 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-c6ba17c0-749a-4ee6-8c7d-0f0f040535f8 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c" status: 200 len: 1280 microversion: 2.1 time: 0.401250 Jul 30 04:58:38.817845 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 23/42] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:58:38 2022] GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c => generated 1280 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:58:38.972168 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-226deffd-ecbf-4ae2-bc3e-d414af99d41c tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:58:38.972798 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-226deffd-ecbf-4ae2-bc3e-d414af99d41c tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:58:39.001870 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-226deffd-ecbf-4ae2-bc3e-d414af99d41c tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:39.010304 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-226deffd-ecbf-4ae2-bc3e-d414af99d41c tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:39.015354 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-226deffd-ecbf-4ae2-bc3e-d414af99d41c tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:39.016099 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-226deffd-ecbf-4ae2-bc3e-d414af99d41c tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:39.371707 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-226deffd-ecbf-4ae2-bc3e-d414af99d41c tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:39.382129 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-226deffd-ecbf-4ae2-bc3e-d414af99d41c tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:39.385128 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-226deffd-ecbf-4ae2-bc3e-d414af99d41c tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:39.386677 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-226deffd-ecbf-4ae2-bc3e-d414af99d41c tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1339 microversion: 2.20 time: 0.419842 Jul 30 04:58:39.388026 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 20/43] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 04:58:38 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1339 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 04:58:39.437073 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-cfa49654-77c9-4ce3-a5d9-1232236b1a3a tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:58:39.437693 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-cfa49654-77c9-4ce3-a5d9-1232236b1a3a tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] [instance: 5348eee1-b615-4ef5-a4db-5deec1276724] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:58:39.447238 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cfa49654-77c9-4ce3-a5d9-1232236b1a3a tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:39.451470 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cfa49654-77c9-4ce3-a5d9-1232236b1a3a tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:39.452582 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cfa49654-77c9-4ce3-a5d9-1232236b1a3a tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:39.453404 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cfa49654-77c9-4ce3-a5d9-1232236b1a3a tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:39.543955 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-7366e64a-c0a6-4b2f-b02f-a3e5cb8de480 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:58:39.544588 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-7366e64a-c0a6-4b2f-b02f-a3e5cb8de480 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: f27c16ec-7d74-4a2a-9b40-c95455fa8aff] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:58:39.558802 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7366e64a-c0a6-4b2f-b02f-a3e5cb8de480 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:39.560081 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7366e64a-c0a6-4b2f-b02f-a3e5cb8de480 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:39.560906 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7366e64a-c0a6-4b2f-b02f-a3e5cb8de480 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:39.561421 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7366e64a-c0a6-4b2f-b02f-a3e5cb8de480 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:39.824593 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell0:SELECT=4 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 04:58:39.848956 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-7366e64a-c0a6-4b2f-b02f-a3e5cb8de480 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8abb58f9c274e568d2d0fe3d4df11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01500cb03c74d1082090cd1c1836169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:39.873311 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-7366e64a-c0a6-4b2f-b02f-a3e5cb8de480 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff" status: 200 len: 1299 microversion: 2.1 time: 0.333982 Jul 30 04:58:39.874312 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 21/44] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:58:39 2022] GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff => generated 1299 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 04:58:39.881473 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-c114631a-6033-435a-832b-7fb0cbc15ed3 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:58:39.883119 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-c114631a-6033-435a-832b-7fb0cbc15ed3 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 7b5e218d-8660-4d90-90d1-9c8e50a66a7c] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:58:39.900113 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c114631a-6033-435a-832b-7fb0cbc15ed3 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:39.901069 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c114631a-6033-435a-832b-7fb0cbc15ed3 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:39.902594 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c114631a-6033-435a-832b-7fb0cbc15ed3 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:39.903270 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c114631a-6033-435a-832b-7fb0cbc15ed3 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:40.096084 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-cfa49654-77c9-4ce3-a5d9-1232236b1a3a tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691a9c5e4d534dcc9c26f8cf88cd7fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5fe5ac675540c0930bd7bab0d8b27f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:40.108413 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-cfa49654-77c9-4ce3-a5d9-1232236b1a3a tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] 10.222.0.20 "GET /compute/v2.1/servers/5348eee1-b615-4ef5-a4db-5deec1276724" status: 200 len: 1273 microversion: 2.1 time: 0.676009 Jul 30 04:58:40.111348 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 24/45] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:58:39 2022] GET /compute/v2.1/servers/5348eee1-b615-4ef5-a4db-5deec1276724 => generated 1273 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:58:40.197086 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-c114631a-6033-435a-832b-7fb0cbc15ed3 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:40.219733 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-c114631a-6033-435a-832b-7fb0cbc15ed3 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c" status: 200 len: 1280 microversion: 2.1 time: 0.343804 Jul 30 04:58:40.241957 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 22/46] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:58:39 2022] GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c => generated 1280 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:58:40.419890 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-28638b69-3d48-4437-b560-d5d1a83361c9 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:58:40.420950 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-28638b69-3d48-4437-b560-d5d1a83361c9 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:58:40.441039 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-28638b69-3d48-4437-b560-d5d1a83361c9 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:40.444239 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-28638b69-3d48-4437-b560-d5d1a83361c9 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:40.449204 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-28638b69-3d48-4437-b560-d5d1a83361c9 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:40.450534 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-28638b69-3d48-4437-b560-d5d1a83361c9 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:40.780248 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-28638b69-3d48-4437-b560-d5d1a83361c9 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:40.797516 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-28638b69-3d48-4437-b560-d5d1a83361c9 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:40.808724 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-28638b69-3d48-4437-b560-d5d1a83361c9 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:40.811187 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-28638b69-3d48-4437-b560-d5d1a83361c9 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1339 microversion: 2.20 time: 0.395652 Jul 30 04:58:40.817588 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 25/47] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 04:58:40 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1339 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 04:58:40.897609 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-76c75504-b19f-4c3b-b419-c330272e4d33 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:58:40.898779 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-76c75504-b19f-4c3b-b419-c330272e4d33 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: f27c16ec-7d74-4a2a-9b40-c95455fa8aff] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:58:40.935391 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-76c75504-b19f-4c3b-b419-c330272e4d33 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:40.937288 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-76c75504-b19f-4c3b-b419-c330272e4d33 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:40.944592 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-76c75504-b19f-4c3b-b419-c330272e4d33 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:40.947275 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-76c75504-b19f-4c3b-b419-c330272e4d33 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:41.135424 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-f4803649-6701-4721-9e4a-4cecc67e3160 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:58:41.136240 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-f4803649-6701-4721-9e4a-4cecc67e3160 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] [instance: 5348eee1-b615-4ef5-a4db-5deec1276724] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:58:41.170821 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f4803649-6701-4721-9e4a-4cecc67e3160 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:41.173858 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f4803649-6701-4721-9e4a-4cecc67e3160 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:41.180169 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f4803649-6701-4721-9e4a-4cecc67e3160 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:41.186741 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f4803649-6701-4721-9e4a-4cecc67e3160 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:41.233341 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-76c75504-b19f-4c3b-b419-c330272e4d33 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8abb58f9c274e568d2d0fe3d4df11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01500cb03c74d1082090cd1c1836169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:41.246963 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-76c75504-b19f-4c3b-b419-c330272e4d33 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff" status: 200 len: 1299 microversion: 2.1 time: 0.351883 Jul 30 04:58:41.260452 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 23/48] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:58:40 2022] GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff => generated 1299 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:58:41.265555 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-61057b37-f425-4bff-982f-6e2222f7b27e tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:58:41.265555 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-61057b37-f425-4bff-982f-6e2222f7b27e tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 7b5e218d-8660-4d90-90d1-9c8e50a66a7c] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:58:41.287278 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 04:58:41.292953 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-61057b37-f425-4bff-982f-6e2222f7b27e tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:41.293699 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-61057b37-f425-4bff-982f-6e2222f7b27e tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:41.295251 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-61057b37-f425-4bff-982f-6e2222f7b27e tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:41.299433 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-61057b37-f425-4bff-982f-6e2222f7b27e tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:41.356686 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell1:SELECT=100 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 04:58:41.487149 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell0:SELECT=6 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 04:58:41.530748 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell0:SELECT=24 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 04:58:41.738582 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-f4803649-6701-4721-9e4a-4cecc67e3160 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691a9c5e4d534dcc9c26f8cf88cd7fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5fe5ac675540c0930bd7bab0d8b27f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:41.743807 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=100 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 04:58:41.752374 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-f4803649-6701-4721-9e4a-4cecc67e3160 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] 10.222.0.20 "GET /compute/v2.1/servers/5348eee1-b615-4ef5-a4db-5deec1276724" status: 200 len: 1315 microversion: 2.1 time: 0.623984 Jul 30 04:58:41.757352 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 26/49] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:58:41 2022] GET /compute/v2.1/servers/5348eee1-b615-4ef5-a4db-5deec1276724 => generated 1315 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 04:58:41.846893 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-94aa95e2-673a-43c0-ae88-42470d12e0ad tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:58:41.847601 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-94aa95e2-673a-43c0-ae88-42470d12e0ad tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:58:41.850225 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell0:SELECT=24 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 04:58:41.868002 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-94aa95e2-673a-43c0-ae88-42470d12e0ad tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:41.868823 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-94aa95e2-673a-43c0-ae88-42470d12e0ad tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:41.869683 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-94aa95e2-673a-43c0-ae88-42470d12e0ad tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:41.870247 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-94aa95e2-673a-43c0-ae88-42470d12e0ad tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:42.019352 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-94aa95e2-673a-43c0-ae88-42470d12e0ad tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:42.045272 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-94aa95e2-673a-43c0-ae88-42470d12e0ad tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:42.052042 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-94aa95e2-673a-43c0-ae88-42470d12e0ad tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:42.055624 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-94aa95e2-673a-43c0-ae88-42470d12e0ad tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1339 microversion: 2.20 time: 0.212270 Jul 30 04:58:42.058527 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 27/50] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 04:58:41 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1339 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 04:58:42.156491 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-61057b37-f425-4bff-982f-6e2222f7b27e tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:42.167721 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-61057b37-f425-4bff-982f-6e2222f7b27e tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c" status: 200 len: 1322 microversion: 2.1 time: 0.915764 Jul 30 04:58:42.182588 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 24/51] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:58:41 2022] GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c => generated 1322 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:58:42.276955 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-ea7803c2-8ba0-46a0-a0bd-d8ed924667fe tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:58:42.278414 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-ea7803c2-8ba0-46a0-a0bd-d8ed924667fe tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: f27c16ec-7d74-4a2a-9b40-c95455fa8aff] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:58:42.304651 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ea7803c2-8ba0-46a0-a0bd-d8ed924667fe tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:42.309227 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ea7803c2-8ba0-46a0-a0bd-d8ed924667fe tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:42.311539 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ea7803c2-8ba0-46a0-a0bd-d8ed924667fe tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:42.313250 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ea7803c2-8ba0-46a0-a0bd-d8ed924667fe tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:42.780612 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-b7414123-d2de-42bd-bf7e-7c1f3a79b519 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:58:42.781323 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-b7414123-d2de-42bd-bf7e-7c1f3a79b519 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] [instance: 5348eee1-b615-4ef5-a4db-5deec1276724] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:58:42.797226 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b7414123-d2de-42bd-bf7e-7c1f3a79b519 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:42.797952 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b7414123-d2de-42bd-bf7e-7c1f3a79b519 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:42.798948 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b7414123-d2de-42bd-bf7e-7c1f3a79b519 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:42.799541 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b7414123-d2de-42bd-bf7e-7c1f3a79b519 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:43.050587 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-ea7803c2-8ba0-46a0-a0bd-d8ed924667fe tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8abb58f9c274e568d2d0fe3d4df11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01500cb03c74d1082090cd1c1836169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:43.062742 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-ea7803c2-8ba0-46a0-a0bd-d8ed924667fe tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff" status: 200 len: 1366 microversion: 2.1 time: 0.793347 Jul 30 04:58:43.063544 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 28/52] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:58:42 2022] GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff => generated 1366 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:58:43.118769 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-6104c854-3822-4de9-b299-417f8ee51cf2 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:58:43.120660 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-6104c854-3822-4de9-b299-417f8ee51cf2 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:58:43.135738 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6104c854-3822-4de9-b299-417f8ee51cf2 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:43.139983 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6104c854-3822-4de9-b299-417f8ee51cf2 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:43.140856 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6104c854-3822-4de9-b299-417f8ee51cf2 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:43.142053 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6104c854-3822-4de9-b299-417f8ee51cf2 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:43.151467 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-b7414123-d2de-42bd-bf7e-7c1f3a79b519 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691a9c5e4d534dcc9c26f8cf88cd7fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5fe5ac675540c0930bd7bab0d8b27f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:43.159721 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-b7414123-d2de-42bd-bf7e-7c1f3a79b519 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] 10.222.0.20 "GET /compute/v2.1/servers/5348eee1-b615-4ef5-a4db-5deec1276724" status: 200 len: 1315 microversion: 2.1 time: 0.382977 Jul 30 04:58:43.176570 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 25/53] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:58:42 2022] GET /compute/v2.1/servers/5348eee1-b615-4ef5-a4db-5deec1276724 => generated 1315 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 04:58:43.197402 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-85da833f-2e91-4f9c-b495-197d76fefa18 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:58:43.199276 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-85da833f-2e91-4f9c-b495-197d76fefa18 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 7b5e218d-8660-4d90-90d1-9c8e50a66a7c] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:58:43.211814 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-85da833f-2e91-4f9c-b495-197d76fefa18 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:43.212708 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-85da833f-2e91-4f9c-b495-197d76fefa18 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:43.214088 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-85da833f-2e91-4f9c-b495-197d76fefa18 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:43.214934 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-85da833f-2e91-4f9c-b495-197d76fefa18 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:43.317979 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-6104c854-3822-4de9-b299-417f8ee51cf2 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:43.339404 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-6104c854-3822-4de9-b299-417f8ee51cf2 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:43.342213 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-6104c854-3822-4de9-b299-417f8ee51cf2 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:43.346795 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-6104c854-3822-4de9-b299-417f8ee51cf2 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1407 microversion: 2.20 time: 0.251493 Jul 30 04:58:43.347519 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 29/54] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 04:58:43 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1407 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 04:58:43.400680 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-85da833f-2e91-4f9c-b495-197d76fefa18 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:43.411023 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-85da833f-2e91-4f9c-b495-197d76fefa18 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c" status: 200 len: 1322 microversion: 2.1 time: 0.219621 Jul 30 04:58:43.411817 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 26/55] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:58:43 2022] GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c => generated 1322 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:58:44.085298 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-730aa58d-c450-4a11-a63a-913dd988b0d6 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:58:44.086754 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-730aa58d-c450-4a11-a63a-913dd988b0d6 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: f27c16ec-7d74-4a2a-9b40-c95455fa8aff] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:58:44.089983 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 04:58:44.093994 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-730aa58d-c450-4a11-a63a-913dd988b0d6 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:44.094669 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-730aa58d-c450-4a11-a63a-913dd988b0d6 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:44.095608 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-730aa58d-c450-4a11-a63a-913dd988b0d6 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:44.096192 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-730aa58d-c450-4a11-a63a-913dd988b0d6 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:44.182204 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-5d46bc50-aeb7-4c83-920f-f7f47cec8e23 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:58:44.182861 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-5d46bc50-aeb7-4c83-920f-f7f47cec8e23 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] [instance: 5348eee1-b615-4ef5-a4db-5deec1276724] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:58:44.201374 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5d46bc50-aeb7-4c83-920f-f7f47cec8e23 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:44.201876 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5d46bc50-aeb7-4c83-920f-f7f47cec8e23 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:44.204711 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5d46bc50-aeb7-4c83-920f-f7f47cec8e23 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:44.205214 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5d46bc50-aeb7-4c83-920f-f7f47cec8e23 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:44.306095 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-730aa58d-c450-4a11-a63a-913dd988b0d6 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8abb58f9c274e568d2d0fe3d4df11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01500cb03c74d1082090cd1c1836169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:44.326833 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-730aa58d-c450-4a11-a63a-913dd988b0d6 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff" status: 200 len: 1366 microversion: 2.1 time: 0.244318 Jul 30 04:58:44.344074 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 30/56] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:58:44 2022] GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff => generated 1366 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 04:58:44.375501 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-5180b84b-6089-4547-a649-eb960ea618fc tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:58:44.376241 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-5180b84b-6089-4547-a649-eb960ea618fc tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:58:44.387126 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5180b84b-6089-4547-a649-eb960ea618fc tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:44.404660 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5180b84b-6089-4547-a649-eb960ea618fc tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:44.405676 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5180b84b-6089-4547-a649-eb960ea618fc tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:44.427845 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5180b84b-6089-4547-a649-eb960ea618fc tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:44.578617 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-5d46bc50-aeb7-4c83-920f-f7f47cec8e23 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691a9c5e4d534dcc9c26f8cf88cd7fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5fe5ac675540c0930bd7bab0d8b27f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:44.591395 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-5d46bc50-aeb7-4c83-920f-f7f47cec8e23 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] 10.222.0.20 "GET /compute/v2.1/servers/5348eee1-b615-4ef5-a4db-5deec1276724" status: 200 len: 1315 microversion: 2.1 time: 0.413825 Jul 30 04:58:44.593330 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 27/57] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:58:44 2022] GET /compute/v2.1/servers/5348eee1-b615-4ef5-a4db-5deec1276724 => generated 1315 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 04:58:44.621146 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-519f02b2-62e4-4387-ab7f-e4972e19e587 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:58:44.621953 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-519f02b2-62e4-4387-ab7f-e4972e19e587 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 7b5e218d-8660-4d90-90d1-9c8e50a66a7c] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:58:44.645485 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-519f02b2-62e4-4387-ab7f-e4972e19e587 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:44.646068 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-519f02b2-62e4-4387-ab7f-e4972e19e587 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:44.646927 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-519f02b2-62e4-4387-ab7f-e4972e19e587 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:44.647461 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-519f02b2-62e4-4387-ab7f-e4972e19e587 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:44.793692 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-5180b84b-6089-4547-a649-eb960ea618fc tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:44.809656 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-5180b84b-6089-4547-a649-eb960ea618fc tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:44.813086 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-5180b84b-6089-4547-a649-eb960ea618fc tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:44.833920 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-5180b84b-6089-4547-a649-eb960ea618fc tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1407 microversion: 2.20 time: 0.461260 Jul 30 04:58:44.835311 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 31/58] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 04:58:44 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1407 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 04:58:45.018628 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-519f02b2-62e4-4387-ab7f-e4972e19e587 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:45.032781 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-519f02b2-62e4-4387-ab7f-e4972e19e587 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c" status: 200 len: 1322 microversion: 2.1 time: 0.428085 Jul 30 04:58:45.046464 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 28/59] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:58:44 2022] GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c => generated 1322 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:58:45.360519 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-4f120111-a42d-49cd-b154-ad6130ea8c3d tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:58:45.361918 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-4f120111-a42d-49cd-b154-ad6130ea8c3d tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: f27c16ec-7d74-4a2a-9b40-c95455fa8aff] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:58:45.380777 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4f120111-a42d-49cd-b154-ad6130ea8c3d tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:45.381619 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4f120111-a42d-49cd-b154-ad6130ea8c3d tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:45.383569 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4f120111-a42d-49cd-b154-ad6130ea8c3d tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:45.386210 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4f120111-a42d-49cd-b154-ad6130ea8c3d tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:45.620849 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-77ef1f53-2b43-451d-9981-1fd6321a77e3 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:58:45.622606 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-77ef1f53-2b43-451d-9981-1fd6321a77e3 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] [instance: 5348eee1-b615-4ef5-a4db-5deec1276724] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:58:45.640411 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-77ef1f53-2b43-451d-9981-1fd6321a77e3 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:45.655646 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-77ef1f53-2b43-451d-9981-1fd6321a77e3 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:45.656644 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-77ef1f53-2b43-451d-9981-1fd6321a77e3 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:45.663970 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-77ef1f53-2b43-451d-9981-1fd6321a77e3 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:45.940961 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-4f120111-a42d-49cd-b154-ad6130ea8c3d tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8abb58f9c274e568d2d0fe3d4df11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01500cb03c74d1082090cd1c1836169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:45.955972 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-4f120111-a42d-49cd-b154-ad6130ea8c3d tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff" status: 200 len: 1366 microversion: 2.1 time: 0.603900 Jul 30 04:58:45.956928 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 32/60] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:58:45 2022] GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff => generated 1366 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:58:45.965424 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-47a2e0c5-b59e-4095-b429-5d75a748346d tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:58:45.972221 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-47a2e0c5-b59e-4095-b429-5d75a748346d tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:58:45.992606 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-47a2e0c5-b59e-4095-b429-5d75a748346d tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:45.994947 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-47a2e0c5-b59e-4095-b429-5d75a748346d tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:45.996033 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-47a2e0c5-b59e-4095-b429-5d75a748346d tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:46.000205 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-47a2e0c5-b59e-4095-b429-5d75a748346d tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:46.499428 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-47a2e0c5-b59e-4095-b429-5d75a748346d tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:46.515979 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-47a2e0c5-b59e-4095-b429-5d75a748346d tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:46.520288 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-47a2e0c5-b59e-4095-b429-5d75a748346d tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:46.524867 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-47a2e0c5-b59e-4095-b429-5d75a748346d tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1407 microversion: 2.20 time: 0.566260 Jul 30 04:58:46.526116 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 33/61] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 04:58:45 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1407 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 04:58:46.553527 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-69467300-034b-45ac-8aac-987972932777 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:58:46.554583 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-69467300-034b-45ac-8aac-987972932777 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 7b5e218d-8660-4d90-90d1-9c8e50a66a7c] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:58:46.561951 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-69467300-034b-45ac-8aac-987972932777 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:46.563838 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-69467300-034b-45ac-8aac-987972932777 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:46.565479 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-69467300-034b-45ac-8aac-987972932777 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:46.566559 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-69467300-034b-45ac-8aac-987972932777 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:47.135422 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-69467300-034b-45ac-8aac-987972932777 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:47.175539 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-69467300-034b-45ac-8aac-987972932777 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c" status: 200 len: 1322 microversion: 2.1 time: 0.643301 Jul 30 04:58:47.180719 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 34/62] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:58:46 2022] GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c => generated 1322 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:58:47.197017 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-9ff389fb-3d25-49e3-8fa3-4914349daf17 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:58:47.198104 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-9ff389fb-3d25-49e3-8fa3-4914349daf17 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: f27c16ec-7d74-4a2a-9b40-c95455fa8aff] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:58:47.214886 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9ff389fb-3d25-49e3-8fa3-4914349daf17 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:47.217156 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9ff389fb-3d25-49e3-8fa3-4914349daf17 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:47.218573 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9ff389fb-3d25-49e3-8fa3-4914349daf17 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:47.224847 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9ff389fb-3d25-49e3-8fa3-4914349daf17 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:47.385531 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-77ef1f53-2b43-451d-9981-1fd6321a77e3 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691a9c5e4d534dcc9c26f8cf88cd7fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5fe5ac675540c0930bd7bab0d8b27f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:47.396132 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-77ef1f53-2b43-451d-9981-1fd6321a77e3 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] 10.222.0.20 "GET /compute/v2.1/servers/5348eee1-b615-4ef5-a4db-5deec1276724" status: 200 len: 1315 microversion: 2.1 time: 1.782873 Jul 30 04:58:47.410889 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 29/63] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:58:45 2022] GET /compute/v2.1/servers/5348eee1-b615-4ef5-a4db-5deec1276724 => generated 1315 bytes in 1791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:58:47.552608 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-9a78fed2-e265-42ce-a95b-99f1a2552abf tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:58:47.553226 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-9a78fed2-e265-42ce-a95b-99f1a2552abf tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:58:47.569926 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9a78fed2-e265-42ce-a95b-99f1a2552abf tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:47.570708 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9a78fed2-e265-42ce-a95b-99f1a2552abf tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:47.572890 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9a78fed2-e265-42ce-a95b-99f1a2552abf tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:47.575418 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9a78fed2-e265-42ce-a95b-99f1a2552abf tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:47.742608 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-9ff389fb-3d25-49e3-8fa3-4914349daf17 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8abb58f9c274e568d2d0fe3d4df11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01500cb03c74d1082090cd1c1836169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:47.757018 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-9ff389fb-3d25-49e3-8fa3-4914349daf17 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff" status: 200 len: 1366 microversion: 2.1 time: 0.573064 Jul 30 04:58:47.776685 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 35/64] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:58:47 2022] GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff => generated 1366 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:58:48.118007 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-e42ae7a7-cfac-4cfb-b18d-0d5fe79e59a1 req-bcc3b1ce-ec70-42a2-a57f-2b418eca18d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b5e218d-8660-4d90-90d1-9c8e50a66a7c", "tag": "46f49659-6b94-4d15-9602-46c795a35ee9"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 04:58:48.133459 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-e42ae7a7-cfac-4cfb-b18d-0d5fe79e59a1 req-bcc3b1ce-ec70-42a2-a57f-2b418eca18d9 service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:48.134194 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-e42ae7a7-cfac-4cfb-b18d-0d5fe79e59a1 req-bcc3b1ce-ec70-42a2-a57f-2b418eca18d9 service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:48.164940 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-e42ae7a7-cfac-4cfb-b18d-0d5fe79e59a1 req-bcc3b1ce-ec70-42a2-a57f-2b418eca18d9 service nova] Creating event network-changed:46f49659-6b94-4d15-9602-46c795a35ee9 for instance 7b5e218d-8660-4d90-90d1-9c8e50a66a7c on hv-cinder-85127 Jul 30 04:58:48.166984 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-e42ae7a7-cfac-4cfb-b18d-0d5fe79e59a1 req-bcc3b1ce-ec70-42a2-a57f-2b418eca18d9 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117886) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 30 04:58:48.168778 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b70ad1d6-337e-44f6-be87-f3b04fcb8d6c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:48.169225 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b70ad1d6-337e-44f6-be87-f3b04fcb8d6c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:48.170534 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b70ad1d6-337e-44f6-be87-f3b04fcb8d6c None None] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:48.171157 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b70ad1d6-337e-44f6-be87-f3b04fcb8d6c None None] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:48.185681 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.compute.rpcapi [None req-b70ad1d6-337e-44f6-be87-f3b04fcb8d6c None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 30 04:58:48.187842 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b70ad1d6-337e-44f6-be87-f3b04fcb8d6c None None] Releasing lock "compute-rpcapi-router" {{(pid=117886) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 30 04:58:48.215473 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-b70ad1d6-337e-44f6-be87-f3b04fcb8d6c None None] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.340998 Jul 30 04:58:48.216954 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 36/65] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Jul 30 04:58:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 04:58:48.224400 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-06991c1e-1f81-4990-98ad-01550f66ddab tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:58:48.225315 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-06991c1e-1f81-4990-98ad-01550f66ddab tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 7b5e218d-8660-4d90-90d1-9c8e50a66a7c] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:58:48.233264 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-06991c1e-1f81-4990-98ad-01550f66ddab tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:48.233971 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-06991c1e-1f81-4990-98ad-01550f66ddab tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:48.235090 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-06991c1e-1f81-4990-98ad-01550f66ddab tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:48.236451 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-06991c1e-1f81-4990-98ad-01550f66ddab tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:48.310861 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-9a78fed2-e265-42ce-a95b-99f1a2552abf tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:48.333748 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-9a78fed2-e265-42ce-a95b-99f1a2552abf tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:48.340009 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-9a78fed2-e265-42ce-a95b-99f1a2552abf tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:48.341164 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-9a78fed2-e265-42ce-a95b-99f1a2552abf tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1407 microversion: 2.20 time: 0.793112 Jul 30 04:58:48.347827 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 30/66] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 04:58:47 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1407 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 04:58:48.404861 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-06991c1e-1f81-4990-98ad-01550f66ddab tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:48.414893 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-06991c1e-1f81-4990-98ad-01550f66ddab tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c" status: 200 len: 1322 microversion: 2.1 time: 0.195613 Jul 30 04:58:48.422826 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 37/67] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:58:48 2022] GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c => generated 1322 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:58:48.422999 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-7d35bbaa-8b37-4d62-ae52-f09385bd3927 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:58:48.423994 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-7d35bbaa-8b37-4d62-ae52-f09385bd3927 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] [instance: 5348eee1-b615-4ef5-a4db-5deec1276724] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:58:48.435050 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7d35bbaa-8b37-4d62-ae52-f09385bd3927 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:48.435526 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7d35bbaa-8b37-4d62-ae52-f09385bd3927 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:48.436869 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7d35bbaa-8b37-4d62-ae52-f09385bd3927 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:48.437319 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7d35bbaa-8b37-4d62-ae52-f09385bd3927 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:48.784224 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-434112c2-df52-4c0e-b231-9bbd548407fd tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:58:48.785858 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-434112c2-df52-4c0e-b231-9bbd548407fd tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: f27c16ec-7d74-4a2a-9b40-c95455fa8aff] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:58:48.801077 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-434112c2-df52-4c0e-b231-9bbd548407fd tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:48.801711 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-434112c2-df52-4c0e-b231-9bbd548407fd tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:48.810905 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-434112c2-df52-4c0e-b231-9bbd548407fd tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:48.811576 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-434112c2-df52-4c0e-b231-9bbd548407fd tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:49.039240 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-7d35bbaa-8b37-4d62-ae52-f09385bd3927 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691a9c5e4d534dcc9c26f8cf88cd7fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5fe5ac675540c0930bd7bab0d8b27f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:49.051234 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-7d35bbaa-8b37-4d62-ae52-f09385bd3927 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] 10.222.0.20 "GET /compute/v2.1/servers/5348eee1-b615-4ef5-a4db-5deec1276724" status: 200 len: 1315 microversion: 2.1 time: 0.632263 Jul 30 04:58:49.069612 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 31/68] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:58:48 2022] GET /compute/v2.1/servers/5348eee1-b615-4ef5-a4db-5deec1276724 => generated 1315 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:58:49.303028 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-434112c2-df52-4c0e-b231-9bbd548407fd tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8abb58f9c274e568d2d0fe3d4df11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01500cb03c74d1082090cd1c1836169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:49.316798 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-434112c2-df52-4c0e-b231-9bbd548407fd tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff" status: 200 len: 1366 microversion: 2.1 time: 0.537196 Jul 30 04:58:49.317386 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 38/69] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:58:48 2022] GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff => generated 1366 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:58:49.365140 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-62ed0da1-2b08-4c40-add9-c543266c3176 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:58:49.366195 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-62ed0da1-2b08-4c40-add9-c543266c3176 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:58:49.372915 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-62ed0da1-2b08-4c40-add9-c543266c3176 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:49.373657 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-62ed0da1-2b08-4c40-add9-c543266c3176 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:49.374685 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-62ed0da1-2b08-4c40-add9-c543266c3176 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:49.375197 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-62ed0da1-2b08-4c40-add9-c543266c3176 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:49.440431 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-82d3c65d-b91e-42e2-b8df-e940ae235d47 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:58:49.441401 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-82d3c65d-b91e-42e2-b8df-e940ae235d47 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 7b5e218d-8660-4d90-90d1-9c8e50a66a7c] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:58:49.448514 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-82d3c65d-b91e-42e2-b8df-e940ae235d47 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:49.449217 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-82d3c65d-b91e-42e2-b8df-e940ae235d47 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:49.450212 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-82d3c65d-b91e-42e2-b8df-e940ae235d47 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:49.450915 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-82d3c65d-b91e-42e2-b8df-e940ae235d47 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:49.679448 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-82d3c65d-b91e-42e2-b8df-e940ae235d47 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:49.687347 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-82d3c65d-b91e-42e2-b8df-e940ae235d47 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c" status: 200 len: 1322 microversion: 2.1 time: 0.251717 Jul 30 04:58:49.688223 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 39/70] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:58:49 2022] GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c => generated 1322 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 04:58:49.827712 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-feee6f8f-ada5-447e-817b-bd62276b4697 req-b9f2f00c-cb6e-4a46-9f4e-cbd34618321e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4370e65-bec4-454f-9566-33ff60441229", "tag": "77f9d403-dee8-430d-8122-9a468f943da2"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 04:58:49.857370 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-feee6f8f-ada5-447e-817b-bd62276b4697 req-b9f2f00c-cb6e-4a46-9f4e-cbd34618321e service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:49.858100 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-feee6f8f-ada5-447e-817b-bd62276b4697 req-b9f2f00c-cb6e-4a46-9f4e-cbd34618321e service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:49.876156 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-feee6f8f-ada5-447e-817b-bd62276b4697 req-b9f2f00c-cb6e-4a46-9f4e-cbd34618321e service nova] Creating event network-changed:77f9d403-dee8-430d-8122-9a468f943da2 for instance e4370e65-bec4-454f-9566-33ff60441229 on hv-cinder-85127 Jul 30 04:58:49.883837 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-feee6f8f-ada5-447e-817b-bd62276b4697 req-b9f2f00c-cb6e-4a46-9f4e-cbd34618321e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.194251 Jul 30 04:58:49.884864 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 40/71] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Jul 30 04:58:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 04:58:50.006975 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-62ed0da1-2b08-4c40-add9-c543266c3176 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:50.024246 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-62ed0da1-2b08-4c40-add9-c543266c3176 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:50.028601 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-62ed0da1-2b08-4c40-add9-c543266c3176 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:50.035761 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-62ed0da1-2b08-4c40-add9-c543266c3176 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1407 microversion: 2.20 time: 0.674846 Jul 30 04:58:50.036352 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 32/72] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 04:58:49 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1407 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 04:58:50.078384 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-8ffa8160-405a-4ce8-90d4-f46540e8fcc7 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:58:50.079211 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-8ffa8160-405a-4ce8-90d4-f46540e8fcc7 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] [instance: 5348eee1-b615-4ef5-a4db-5deec1276724] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:58:50.093434 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8ffa8160-405a-4ce8-90d4-f46540e8fcc7 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:50.094957 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8ffa8160-405a-4ce8-90d4-f46540e8fcc7 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:50.097036 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8ffa8160-405a-4ce8-90d4-f46540e8fcc7 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:50.097474 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8ffa8160-405a-4ce8-90d4-f46540e8fcc7 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:50.238061 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-be36ca2b-7271-4b2c-9589-614cf88d3083 req-f5d2331d-7f0a-4dcb-9f70-4ae994d9fdc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc0c06a0-156a-4cee-8ff7-92ab582bc4a1", "tag": "5f770f5f-036f-49c8-aec8-570d5b12103d"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 04:58:50.264340 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-be36ca2b-7271-4b2c-9589-614cf88d3083 req-f5d2331d-7f0a-4dcb-9f70-4ae994d9fdc8 service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:50.265841 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-be36ca2b-7271-4b2c-9589-614cf88d3083 req-f5d2331d-7f0a-4dcb-9f70-4ae994d9fdc8 service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:50.296993 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-8ffa8160-405a-4ce8-90d4-f46540e8fcc7 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691a9c5e4d534dcc9c26f8cf88cd7fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5fe5ac675540c0930bd7bab0d8b27f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:50.317805 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-be36ca2b-7271-4b2c-9589-614cf88d3083 req-f5d2331d-7f0a-4dcb-9f70-4ae994d9fdc8 service nova] Creating event network-changed:5f770f5f-036f-49c8-aec8-570d5b12103d for instance cc0c06a0-156a-4cee-8ff7-92ab582bc4a1 on hv-cinder-85127 Jul 30 04:58:50.318577 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-be36ca2b-7271-4b2c-9589-614cf88d3083 req-f5d2331d-7f0a-4dcb-9f70-4ae994d9fdc8 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117885) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 30 04:58:50.319543 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-8ffa8160-405a-4ce8-90d4-f46540e8fcc7 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] 10.222.0.20 "GET /compute/v2.1/servers/5348eee1-b615-4ef5-a4db-5deec1276724" status: 200 len: 1315 microversion: 2.1 time: 0.232376 Jul 30 04:58:50.324211 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-592c03b0-293c-45a0-b929-00d86f0ad767 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:50.324857 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-592c03b0-293c-45a0-b929-00d86f0ad767 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:50.326100 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-592c03b0-293c-45a0-b929-00d86f0ad767 None None] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:50.326673 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-592c03b0-293c-45a0-b929-00d86f0ad767 None None] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:50.334998 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 41/73] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:58:50 2022] GET /compute/v2.1/servers/5348eee1-b615-4ef5-a4db-5deec1276724 => generated 1315 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:58:50.348514 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.compute.rpcapi [None req-592c03b0-293c-45a0-b929-00d86f0ad767 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 30 04:58:50.359609 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-592c03b0-293c-45a0-b929-00d86f0ad767 None None] Releasing lock "compute-rpcapi-router" {{(pid=117885) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 30 04:58:50.362609 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-69d57937-dceb-4ef9-9281-be49473341ec tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:58:50.369284 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-69d57937-dceb-4ef9-9281-be49473341ec tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: f27c16ec-7d74-4a2a-9b40-c95455fa8aff] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:58:50.385875 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-69d57937-dceb-4ef9-9281-be49473341ec tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:50.388567 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-592c03b0-293c-45a0-b929-00d86f0ad767 None None] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.153930 Jul 30 04:58:50.389221 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-69d57937-dceb-4ef9-9281-be49473341ec tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:50.393475 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 33/74] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Jul 30 04:58:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 04:58:50.393782 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-69d57937-dceb-4ef9-9281-be49473341ec tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:50.394303 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-69d57937-dceb-4ef9-9281-be49473341ec tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:50.682799 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-69d57937-dceb-4ef9-9281-be49473341ec tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8abb58f9c274e568d2d0fe3d4df11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01500cb03c74d1082090cd1c1836169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:50.696159 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-69d57937-dceb-4ef9-9281-be49473341ec tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff" status: 200 len: 1366 microversion: 2.1 time: 0.355295 Jul 30 04:58:50.698651 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 42/75] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:58:50 2022] GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff => generated 1366 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:58:50.720538 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-297e9269-52ad-4089-9872-658cc7051b4f tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:58:50.721564 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-297e9269-52ad-4089-9872-658cc7051b4f tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 7b5e218d-8660-4d90-90d1-9c8e50a66a7c] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:58:50.731034 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-297e9269-52ad-4089-9872-658cc7051b4f tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:50.731718 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-297e9269-52ad-4089-9872-658cc7051b4f tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:50.732655 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-297e9269-52ad-4089-9872-658cc7051b4f tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:50.733238 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-297e9269-52ad-4089-9872-658cc7051b4f tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:50.967823 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-297e9269-52ad-4089-9872-658cc7051b4f tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:50.980781 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-297e9269-52ad-4089-9872-658cc7051b4f tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c" status: 200 len: 1322 microversion: 2.1 time: 0.267475 Jul 30 04:58:50.994494 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 34/76] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:58:50 2022] GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c => generated 1322 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:58:51.071452 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-8be937a9-ba5a-472b-89fc-2492e09d05c3 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:58:51.072065 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-8be937a9-ba5a-472b-89fc-2492e09d05c3 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:58:51.082869 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8be937a9-ba5a-472b-89fc-2492e09d05c3 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:51.084945 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8be937a9-ba5a-472b-89fc-2492e09d05c3 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:51.087633 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8be937a9-ba5a-472b-89fc-2492e09d05c3 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:51.088604 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8be937a9-ba5a-472b-89fc-2492e09d05c3 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:51.344205 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-8be937a9-ba5a-472b-89fc-2492e09d05c3 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:51.348830 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-90cf376e-9a70-4e50-84e2-db6ebe9ba874 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:58:51.352986 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-90cf376e-9a70-4e50-84e2-db6ebe9ba874 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] [instance: 5348eee1-b615-4ef5-a4db-5deec1276724] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:58:51.361242 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-90cf376e-9a70-4e50-84e2-db6ebe9ba874 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:51.361483 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-8be937a9-ba5a-472b-89fc-2492e09d05c3 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:51.361699 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-90cf376e-9a70-4e50-84e2-db6ebe9ba874 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:51.362653 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-90cf376e-9a70-4e50-84e2-db6ebe9ba874 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:51.363283 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-8be937a9-ba5a-472b-89fc-2492e09d05c3 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:51.363412 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-90cf376e-9a70-4e50-84e2-db6ebe9ba874 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:51.364343 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-8be937a9-ba5a-472b-89fc-2492e09d05c3 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1407 microversion: 2.20 time: 0.298924 Jul 30 04:58:51.364880 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 43/77] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 04:58:51 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1407 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 04:58:51.501925 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-90cf376e-9a70-4e50-84e2-db6ebe9ba874 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691a9c5e4d534dcc9c26f8cf88cd7fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5fe5ac675540c0930bd7bab0d8b27f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:51.510151 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-90cf376e-9a70-4e50-84e2-db6ebe9ba874 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] 10.222.0.20 "GET /compute/v2.1/servers/5348eee1-b615-4ef5-a4db-5deec1276724" status: 200 len: 1315 microversion: 2.1 time: 0.172157 Jul 30 04:58:51.510787 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 35/78] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:58:51 2022] GET /compute/v2.1/servers/5348eee1-b615-4ef5-a4db-5deec1276724 => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 04:58:51.718634 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-575a38d0-297f-4e99-91f7-aafd5260aaab tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:58:51.719306 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-575a38d0-297f-4e99-91f7-aafd5260aaab tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: f27c16ec-7d74-4a2a-9b40-c95455fa8aff] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:58:51.725451 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-575a38d0-297f-4e99-91f7-aafd5260aaab tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:51.725942 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-575a38d0-297f-4e99-91f7-aafd5260aaab tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:51.726734 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-575a38d0-297f-4e99-91f7-aafd5260aaab tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:51.727174 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-575a38d0-297f-4e99-91f7-aafd5260aaab tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:51.748744 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=100 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 04:58:51.868019 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-575a38d0-297f-4e99-91f7-aafd5260aaab tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8abb58f9c274e568d2d0fe3d4df11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01500cb03c74d1082090cd1c1836169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:51.875431 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-575a38d0-297f-4e99-91f7-aafd5260aaab tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff" status: 200 len: 1366 microversion: 2.1 time: 0.161242 Jul 30 04:58:51.876001 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 44/79] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:58:51 2022] GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:58:51.989307 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-8163db7d-e7ac-4c6c-ae6a-193fff3e4bdc req-3023acd3-e549-4512-9eba-c7ba3eb9053a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f27c16ec-7d74-4a2a-9b40-c95455fa8aff", "tag": "17ee318c-931e-496a-b49d-170e9dd9ad2b"}, {"name": "network-changed", "server_uuid": "5348eee1-b615-4ef5-a4db-5deec1276724", "tag": "c19fc198-7bdb-497c-b40d-78705a7b0ac9"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 04:58:52.000484 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-8163db7d-e7ac-4c6c-ae6a-193fff3e4bdc req-3023acd3-e549-4512-9eba-c7ba3eb9053a service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:52.000922 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-8163db7d-e7ac-4c6c-ae6a-193fff3e4bdc req-3023acd3-e549-4512-9eba-c7ba3eb9053a service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:52.002982 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-4a419a0b-ad5e-4212-b4f3-6d66968817fd tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:58:52.003634 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-4a419a0b-ad5e-4212-b4f3-6d66968817fd tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 7b5e218d-8660-4d90-90d1-9c8e50a66a7c] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:58:52.010589 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4a419a0b-ad5e-4212-b4f3-6d66968817fd tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:52.011050 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4a419a0b-ad5e-4212-b4f3-6d66968817fd tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:52.011824 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4a419a0b-ad5e-4212-b4f3-6d66968817fd tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:52.012268 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4a419a0b-ad5e-4212-b4f3-6d66968817fd tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:52.015546 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-8163db7d-e7ac-4c6c-ae6a-193fff3e4bdc req-3023acd3-e549-4512-9eba-c7ba3eb9053a service nova] Creating event network-changed:17ee318c-931e-496a-b49d-170e9dd9ad2b for instance f27c16ec-7d74-4a2a-9b40-c95455fa8aff on hv-cinder-85127 Jul 30 04:58:52.016179 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-8163db7d-e7ac-4c6c-ae6a-193fff3e4bdc req-3023acd3-e549-4512-9eba-c7ba3eb9053a service nova] Creating event network-changed:c19fc198-7bdb-497c-b40d-78705a7b0ac9 for instance 5348eee1-b615-4ef5-a4db-5deec1276724 on hv-cinder-85127 Jul 30 04:58:52.023360 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-8163db7d-e7ac-4c6c-ae6a-193fff3e4bdc req-3023acd3-e549-4512-9eba-c7ba3eb9053a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.036883 Jul 30 04:58:52.024309 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 36/80] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Jul 30 04:58:51 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 04:58:52.145692 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-4a419a0b-ad5e-4212-b4f3-6d66968817fd tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:52.153488 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-4a419a0b-ad5e-4212-b4f3-6d66968817fd tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c" status: 200 len: 1322 microversion: 2.1 time: 0.154196 Jul 30 04:58:52.153987 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 45/81] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:58:51 2022] GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 04:58:52.393494 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-75cdc0f6-d859-4ac8-baba-40fcb5cac805 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:58:52.394119 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-75cdc0f6-d859-4ac8-baba-40fcb5cac805 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:58:52.400989 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-75cdc0f6-d859-4ac8-baba-40fcb5cac805 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:52.401442 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-75cdc0f6-d859-4ac8-baba-40fcb5cac805 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:52.402208 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-75cdc0f6-d859-4ac8-baba-40fcb5cac805 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:52.402673 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-75cdc0f6-d859-4ac8-baba-40fcb5cac805 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:52.528702 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-75cdc0f6-d859-4ac8-baba-40fcb5cac805 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:52.531209 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-960fbdfc-1d7c-4ce9-92c9-f0ade626627f tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:58:52.531960 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-960fbdfc-1d7c-4ce9-92c9-f0ade626627f tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] [instance: 5348eee1-b615-4ef5-a4db-5deec1276724] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:58:52.536783 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-75cdc0f6-d859-4ac8-baba-40fcb5cac805 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:52.537849 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-960fbdfc-1d7c-4ce9-92c9-f0ade626627f tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:52.539039 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-960fbdfc-1d7c-4ce9-92c9-f0ade626627f tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:52.539187 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-75cdc0f6-d859-4ac8-baba-40fcb5cac805 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:52.540149 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-960fbdfc-1d7c-4ce9-92c9-f0ade626627f tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:52.540243 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-75cdc0f6-d859-4ac8-baba-40fcb5cac805 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1407 microversion: 2.20 time: 0.150989 Jul 30 04:58:52.540597 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-960fbdfc-1d7c-4ce9-92c9-f0ade626627f tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:52.540909 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 37/82] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 04:58:52 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 04:58:52.670032 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-960fbdfc-1d7c-4ce9-92c9-f0ade626627f tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691a9c5e4d534dcc9c26f8cf88cd7fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5fe5ac675540c0930bd7bab0d8b27f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:52.677406 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-960fbdfc-1d7c-4ce9-92c9-f0ade626627f tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] 10.222.0.20 "GET /compute/v2.1/servers/5348eee1-b615-4ef5-a4db-5deec1276724" status: 200 len: 1315 microversion: 2.1 time: 0.150141 Jul 30 04:58:52.677961 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 46/83] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:58:52 2022] GET /compute/v2.1/servers/5348eee1-b615-4ef5-a4db-5deec1276724 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:58:52.896680 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-5e5eef7d-4f09-40ba-ad68-198ee9f70ed7 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:58:52.897323 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-5e5eef7d-4f09-40ba-ad68-198ee9f70ed7 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: f27c16ec-7d74-4a2a-9b40-c95455fa8aff] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:58:52.903948 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5e5eef7d-4f09-40ba-ad68-198ee9f70ed7 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:52.904401 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5e5eef7d-4f09-40ba-ad68-198ee9f70ed7 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:52.905196 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5e5eef7d-4f09-40ba-ad68-198ee9f70ed7 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:52.905634 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5e5eef7d-4f09-40ba-ad68-198ee9f70ed7 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:53.037132 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-5e5eef7d-4f09-40ba-ad68-198ee9f70ed7 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8abb58f9c274e568d2d0fe3d4df11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01500cb03c74d1082090cd1c1836169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:53.044941 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-5e5eef7d-4f09-40ba-ad68-198ee9f70ed7 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff" status: 200 len: 1366 microversion: 2.1 time: 0.151890 Jul 30 04:58:53.045503 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 38/84] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:58:52 2022] GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 04:58:53.174640 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-c1967f34-c487-42b4-96ad-d4dee0b74985 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:58:53.175251 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-c1967f34-c487-42b4-96ad-d4dee0b74985 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 7b5e218d-8660-4d90-90d1-9c8e50a66a7c] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:58:53.181981 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c1967f34-c487-42b4-96ad-d4dee0b74985 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:53.182426 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c1967f34-c487-42b4-96ad-d4dee0b74985 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:53.183201 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c1967f34-c487-42b4-96ad-d4dee0b74985 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:53.183636 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c1967f34-c487-42b4-96ad-d4dee0b74985 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:53.310150 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-c1967f34-c487-42b4-96ad-d4dee0b74985 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:53.317472 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-c1967f34-c487-42b4-96ad-d4dee0b74985 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c" status: 200 len: 1322 microversion: 2.1 time: 0.146608 Jul 30 04:58:53.318026 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 47/85] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:58:53 2022] GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c => generated 1322 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:58:53.562902 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-ebfbf773-df22-4e52-8a76-3cb34be0c2c5 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:58:53.563484 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-ebfbf773-df22-4e52-8a76-3cb34be0c2c5 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:58:53.569587 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ebfbf773-df22-4e52-8a76-3cb34be0c2c5 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:53.570088 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ebfbf773-df22-4e52-8a76-3cb34be0c2c5 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:53.570891 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ebfbf773-df22-4e52-8a76-3cb34be0c2c5 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:53.571332 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ebfbf773-df22-4e52-8a76-3cb34be0c2c5 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:53.697115 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-b69c4dd6-945a-46aa-ac8c-89ec59738fc1 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:58:53.697688 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-ebfbf773-df22-4e52-8a76-3cb34be0c2c5 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:53.697808 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-b69c4dd6-945a-46aa-ac8c-89ec59738fc1 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] [instance: 5348eee1-b615-4ef5-a4db-5deec1276724] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:58:53.703704 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b69c4dd6-945a-46aa-ac8c-89ec59738fc1 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:53.704140 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b69c4dd6-945a-46aa-ac8c-89ec59738fc1 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:53.704890 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b69c4dd6-945a-46aa-ac8c-89ec59738fc1 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:53.705319 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b69c4dd6-945a-46aa-ac8c-89ec59738fc1 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:53.705569 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-ebfbf773-df22-4e52-8a76-3cb34be0c2c5 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:53.707115 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-ebfbf773-df22-4e52-8a76-3cb34be0c2c5 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:53.708333 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-ebfbf773-df22-4e52-8a76-3cb34be0c2c5 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1407 microversion: 2.20 time: 0.149359 Jul 30 04:58:53.709347 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 39/86] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 04:58:53 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1407 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 04:58:53.878664 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-b69c4dd6-945a-46aa-ac8c-89ec59738fc1 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691a9c5e4d534dcc9c26f8cf88cd7fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5fe5ac675540c0930bd7bab0d8b27f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:53.886853 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-b69c4dd6-945a-46aa-ac8c-89ec59738fc1 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] 10.222.0.20 "GET /compute/v2.1/servers/5348eee1-b615-4ef5-a4db-5deec1276724" status: 200 len: 1315 microversion: 2.1 time: 0.193515 Jul 30 04:58:53.887450 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 48/87] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:58:53 2022] GET /compute/v2.1/servers/5348eee1-b615-4ef5-a4db-5deec1276724 => generated 1315 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 04:58:54.073451 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-996be5dd-b3fe-4dd7-bb42-fc2b473c73c3 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:58:54.074326 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-996be5dd-b3fe-4dd7-bb42-fc2b473c73c3 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: f27c16ec-7d74-4a2a-9b40-c95455fa8aff] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:58:54.089915 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-996be5dd-b3fe-4dd7-bb42-fc2b473c73c3 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:54.090749 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-996be5dd-b3fe-4dd7-bb42-fc2b473c73c3 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:54.091529 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-996be5dd-b3fe-4dd7-bb42-fc2b473c73c3 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:54.093168 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-996be5dd-b3fe-4dd7-bb42-fc2b473c73c3 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:54.340299 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-16bc3d7f-994b-4c09-a3fc-1473538cde41 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:58:54.341681 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-16bc3d7f-994b-4c09-a3fc-1473538cde41 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 7b5e218d-8660-4d90-90d1-9c8e50a66a7c] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:58:54.358988 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-16bc3d7f-994b-4c09-a3fc-1473538cde41 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:54.360439 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-16bc3d7f-994b-4c09-a3fc-1473538cde41 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:54.361907 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-16bc3d7f-994b-4c09-a3fc-1473538cde41 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:54.362710 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-16bc3d7f-994b-4c09-a3fc-1473538cde41 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:54.849422 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-996be5dd-b3fe-4dd7-bb42-fc2b473c73c3 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8abb58f9c274e568d2d0fe3d4df11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01500cb03c74d1082090cd1c1836169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:54.859577 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-996be5dd-b3fe-4dd7-bb42-fc2b473c73c3 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff" status: 200 len: 1366 microversion: 2.1 time: 0.794785 Jul 30 04:58:54.860361 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 40/88] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:58:54 2022] GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff => generated 1366 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:58:54.871508 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-e8c0774e-f5bd-4894-8115-dab90778edf2 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:58:54.871806 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-16bc3d7f-994b-4c09-a3fc-1473538cde41 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:54.872560 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-e8c0774e-f5bd-4894-8115-dab90778edf2 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:58:54.882343 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-16bc3d7f-994b-4c09-a3fc-1473538cde41 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c" status: 200 len: 1322 microversion: 2.1 time: 0.545554 Jul 30 04:58:54.884144 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 49/89] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:58:54 2022] GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c => generated 1322 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 04:58:54.888932 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e8c0774e-f5bd-4894-8115-dab90778edf2 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:54.890545 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e8c0774e-f5bd-4894-8115-dab90778edf2 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:54.893034 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e8c0774e-f5bd-4894-8115-dab90778edf2 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:54.893814 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e8c0774e-f5bd-4894-8115-dab90778edf2 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:54.908898 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-ffb47b2d-c044-448e-ab87-5c03a87ab9c5 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:58:54.909622 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-ffb47b2d-c044-448e-ab87-5c03a87ab9c5 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] [instance: 5348eee1-b615-4ef5-a4db-5deec1276724] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:58:54.917837 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ffb47b2d-c044-448e-ab87-5c03a87ab9c5 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:54.918543 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ffb47b2d-c044-448e-ab87-5c03a87ab9c5 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:54.919841 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ffb47b2d-c044-448e-ab87-5c03a87ab9c5 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:54.920541 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ffb47b2d-c044-448e-ab87-5c03a87ab9c5 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:55.057093 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-e8c0774e-f5bd-4894-8115-dab90778edf2 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:55.065236 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-e8c0774e-f5bd-4894-8115-dab90778edf2 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:55.066792 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-e8c0774e-f5bd-4894-8115-dab90778edf2 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:55.067904 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-e8c0774e-f5bd-4894-8115-dab90778edf2 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1407 microversion: 2.20 time: 0.206311 Jul 30 04:58:55.068461 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 41/90] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 04:58:54 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1407 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 04:58:55.077739 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-ffb47b2d-c044-448e-ab87-5c03a87ab9c5 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691a9c5e4d534dcc9c26f8cf88cd7fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5fe5ac675540c0930bd7bab0d8b27f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:55.085100 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-ffb47b2d-c044-448e-ab87-5c03a87ab9c5 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] 10.222.0.20 "GET /compute/v2.1/servers/5348eee1-b615-4ef5-a4db-5deec1276724" status: 200 len: 1315 microversion: 2.1 time: 0.180562 Jul 30 04:58:55.085546 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 50/91] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:58:54 2022] GET /compute/v2.1/servers/5348eee1-b615-4ef5-a4db-5deec1276724 => generated 1315 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:58:55.881353 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-bc5b5dde-73ea-4bcc-8600-7bfb56a613ee tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:58:55.882646 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-bc5b5dde-73ea-4bcc-8600-7bfb56a613ee tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: f27c16ec-7d74-4a2a-9b40-c95455fa8aff] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:58:55.888656 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-bc5b5dde-73ea-4bcc-8600-7bfb56a613ee tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:55.889172 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-bc5b5dde-73ea-4bcc-8600-7bfb56a613ee tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:55.889999 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-bc5b5dde-73ea-4bcc-8600-7bfb56a613ee tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:55.890538 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-bc5b5dde-73ea-4bcc-8600-7bfb56a613ee tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:55.894588 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell1:SELECT=100 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 04:58:55.905746 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-dfaf0e8e-5cf3-48fe-8961-8b944bf70902 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:58:55.906550 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-dfaf0e8e-5cf3-48fe-8961-8b944bf70902 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 7b5e218d-8660-4d90-90d1-9c8e50a66a7c] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:58:55.914356 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-dfaf0e8e-5cf3-48fe-8961-8b944bf70902 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:55.914899 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-dfaf0e8e-5cf3-48fe-8961-8b944bf70902 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:55.915593 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-dfaf0e8e-5cf3-48fe-8961-8b944bf70902 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:55.916025 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-dfaf0e8e-5cf3-48fe-8961-8b944bf70902 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:56.045252 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-bc5b5dde-73ea-4bcc-8600-7bfb56a613ee tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8abb58f9c274e568d2d0fe3d4df11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01500cb03c74d1082090cd1c1836169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:56.053099 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-bc5b5dde-73ea-4bcc-8600-7bfb56a613ee tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff" status: 200 len: 1366 microversion: 2.1 time: 0.175549 Jul 30 04:58:56.054480 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 42/92] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:58:55 2022] GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff => generated 1366 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:58:56.068037 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-dfaf0e8e-5cf3-48fe-8961-8b944bf70902 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:56.076743 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-dfaf0e8e-5cf3-48fe-8961-8b944bf70902 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c" status: 200 len: 1322 microversion: 2.1 time: 0.174820 Jul 30 04:58:56.077302 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 51/93] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:58:55 2022] GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c => generated 1322 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 04:58:56.090642 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-1a7ff701-c8c8-4723-a528-04666737fe99 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:58:56.091268 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-1a7ff701-c8c8-4723-a528-04666737fe99 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:58:56.097188 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1a7ff701-c8c8-4723-a528-04666737fe99 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:56.097629 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1a7ff701-c8c8-4723-a528-04666737fe99 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:56.098382 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1a7ff701-c8c8-4723-a528-04666737fe99 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:56.098858 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1a7ff701-c8c8-4723-a528-04666737fe99 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:56.104896 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-de469deb-46d7-4e31-b224-3723bd80db38 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:58:56.105518 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-de469deb-46d7-4e31-b224-3723bd80db38 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] [instance: 5348eee1-b615-4ef5-a4db-5deec1276724] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:58:56.111584 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-de469deb-46d7-4e31-b224-3723bd80db38 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:56.112037 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-de469deb-46d7-4e31-b224-3723bd80db38 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:56.112801 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-de469deb-46d7-4e31-b224-3723bd80db38 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:56.113297 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-de469deb-46d7-4e31-b224-3723bd80db38 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:56.230691 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-1a7ff701-c8c8-4723-a528-04666737fe99 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:56.238931 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-1a7ff701-c8c8-4723-a528-04666737fe99 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:56.240449 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-1a7ff701-c8c8-4723-a528-04666737fe99 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:56.241687 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-1a7ff701-c8c8-4723-a528-04666737fe99 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1407 microversion: 2.20 time: 0.154984 Jul 30 04:58:56.242246 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 43/94] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 04:58:56 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 04:58:56.245987 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-de469deb-46d7-4e31-b224-3723bd80db38 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691a9c5e4d534dcc9c26f8cf88cd7fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5fe5ac675540c0930bd7bab0d8b27f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:56.253281 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-de469deb-46d7-4e31-b224-3723bd80db38 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] 10.222.0.20 "GET /compute/v2.1/servers/5348eee1-b615-4ef5-a4db-5deec1276724" status: 200 len: 1315 microversion: 2.1 time: 0.152159 Jul 30 04:58:56.253824 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 52/95] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:58:56 2022] GET /compute/v2.1/servers/5348eee1-b615-4ef5-a4db-5deec1276724 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 04:58:57.074108 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-4a99ae04-5170-4e5e-9982-25d60f8311a2 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:58:57.074744 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-4a99ae04-5170-4e5e-9982-25d60f8311a2 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: f27c16ec-7d74-4a2a-9b40-c95455fa8aff] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:58:57.080585 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4a99ae04-5170-4e5e-9982-25d60f8311a2 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:57.081027 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4a99ae04-5170-4e5e-9982-25d60f8311a2 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:57.081771 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4a99ae04-5170-4e5e-9982-25d60f8311a2 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:57.082199 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4a99ae04-5170-4e5e-9982-25d60f8311a2 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:57.098663 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-c6066113-e396-45cd-a995-684cf010cd7e tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:58:57.099365 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-c6066113-e396-45cd-a995-684cf010cd7e tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 7b5e218d-8660-4d90-90d1-9c8e50a66a7c] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:58:57.106482 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c6066113-e396-45cd-a995-684cf010cd7e tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:57.106937 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c6066113-e396-45cd-a995-684cf010cd7e tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:57.107699 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c6066113-e396-45cd-a995-684cf010cd7e tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:57.108135 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c6066113-e396-45cd-a995-684cf010cd7e tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:57.212196 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-4a99ae04-5170-4e5e-9982-25d60f8311a2 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8abb58f9c274e568d2d0fe3d4df11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01500cb03c74d1082090cd1c1836169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:57.219546 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-4a99ae04-5170-4e5e-9982-25d60f8311a2 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff" status: 200 len: 1366 microversion: 2.1 time: 0.149148 Jul 30 04:58:57.220115 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 44/96] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:58:57 2022] GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:58:57.239192 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-c6066113-e396-45cd-a995-684cf010cd7e tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:57.246750 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-c6066113-e396-45cd-a995-684cf010cd7e tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c" status: 200 len: 1322 microversion: 2.1 time: 0.151778 Jul 30 04:58:57.247309 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 53/97] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:58:57 2022] GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 04:58:57.263878 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-de75b2f7-f8c4-4577-8074-ce8ef1f5e957 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:58:57.264491 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-de75b2f7-f8c4-4577-8074-ce8ef1f5e957 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:58:57.270425 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-de75b2f7-f8c4-4577-8074-ce8ef1f5e957 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:57.270907 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-de75b2f7-f8c4-4577-8074-ce8ef1f5e957 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:57.271669 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-de75b2f7-f8c4-4577-8074-ce8ef1f5e957 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:57.272109 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-de75b2f7-f8c4-4577-8074-ce8ef1f5e957 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:57.273378 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-f82bb30e-6ede-4c4b-8689-2a1774896fc9 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:58:57.274020 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-f82bb30e-6ede-4c4b-8689-2a1774896fc9 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] [instance: 5348eee1-b615-4ef5-a4db-5deec1276724] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:58:57.280207 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f82bb30e-6ede-4c4b-8689-2a1774896fc9 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:57.280709 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f82bb30e-6ede-4c4b-8689-2a1774896fc9 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:57.281468 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f82bb30e-6ede-4c4b-8689-2a1774896fc9 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:57.281901 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f82bb30e-6ede-4c4b-8689-2a1774896fc9 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:57.714297 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-f82bb30e-6ede-4c4b-8689-2a1774896fc9 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691a9c5e4d534dcc9c26f8cf88cd7fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5fe5ac675540c0930bd7bab0d8b27f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:57.723013 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-f82bb30e-6ede-4c4b-8689-2a1774896fc9 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] 10.222.0.20 "GET /compute/v2.1/servers/5348eee1-b615-4ef5-a4db-5deec1276724" status: 200 len: 1315 microversion: 2.1 time: 0.453895 Jul 30 04:58:57.723907 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 54/98] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:58:57 2022] GET /compute/v2.1/servers/5348eee1-b615-4ef5-a4db-5deec1276724 => generated 1315 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 04:58:57.807692 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-de75b2f7-f8c4-4577-8074-ce8ef1f5e957 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:57.820076 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-de75b2f7-f8c4-4577-8074-ce8ef1f5e957 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:57.822053 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-de75b2f7-f8c4-4577-8074-ce8ef1f5e957 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:57.823652 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-de75b2f7-f8c4-4577-8074-ce8ef1f5e957 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1407 microversion: 2.20 time: 0.563703 Jul 30 04:58:57.840272 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 45/99] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 04:58:57 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1407 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 04:58:58.244131 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-a13de202-9637-4056-8754-1b9e9c5817af tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:58:58.244741 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-a13de202-9637-4056-8754-1b9e9c5817af tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: f27c16ec-7d74-4a2a-9b40-c95455fa8aff] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:58:58.246582 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell0:SELECT=2 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 04:58:58.252161 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a13de202-9637-4056-8754-1b9e9c5817af tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:58.252605 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a13de202-9637-4056-8754-1b9e9c5817af tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:58.253385 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a13de202-9637-4056-8754-1b9e9c5817af tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:58.253811 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a13de202-9637-4056-8754-1b9e9c5817af tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:58.267083 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-8e70c484-0959-47e7-924c-a31dd684c20d tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:58:58.267697 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-8e70c484-0959-47e7-924c-a31dd684c20d tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 7b5e218d-8660-4d90-90d1-9c8e50a66a7c] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:58:58.274836 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8e70c484-0959-47e7-924c-a31dd684c20d tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:58.275322 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8e70c484-0959-47e7-924c-a31dd684c20d tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:58.276088 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8e70c484-0959-47e7-924c-a31dd684c20d tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:58.276523 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8e70c484-0959-47e7-924c-a31dd684c20d tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:58.391285 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-a13de202-9637-4056-8754-1b9e9c5817af tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8abb58f9c274e568d2d0fe3d4df11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01500cb03c74d1082090cd1c1836169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:58.399286 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-a13de202-9637-4056-8754-1b9e9c5817af tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff" status: 200 len: 1366 microversion: 2.1 time: 0.159755 Jul 30 04:58:58.399862 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 55/100] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:58:58 2022] GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:58:58.423715 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-8e70c484-0959-47e7-924c-a31dd684c20d tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:58.431358 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-8e70c484-0959-47e7-924c-a31dd684c20d tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c" status: 200 len: 1322 microversion: 2.1 time: 0.167929 Jul 30 04:58:58.431965 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 46/101] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:58:58 2022] GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c => generated 1322 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 04:58:58.745587 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-26e57ef2-371f-472a-bdd0-d5ac253a57d8 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:58:58.746234 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-26e57ef2-371f-472a-bdd0-d5ac253a57d8 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] [instance: 5348eee1-b615-4ef5-a4db-5deec1276724] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:58:58.752199 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-26e57ef2-371f-472a-bdd0-d5ac253a57d8 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:58.752654 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-26e57ef2-371f-472a-bdd0-d5ac253a57d8 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:58.753428 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-26e57ef2-371f-472a-bdd0-d5ac253a57d8 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:58.753869 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-26e57ef2-371f-472a-bdd0-d5ac253a57d8 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:58.851848 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-427eee84-f254-4152-9751-5bec491059c4 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:58:58.852457 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-427eee84-f254-4152-9751-5bec491059c4 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:58:58.876548 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-427eee84-f254-4152-9751-5bec491059c4 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:58.877906 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-427eee84-f254-4152-9751-5bec491059c4 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:58.878874 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-427eee84-f254-4152-9751-5bec491059c4 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:58.887928 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-427eee84-f254-4152-9751-5bec491059c4 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:58.995053 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-26e57ef2-371f-472a-bdd0-d5ac253a57d8 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691a9c5e4d534dcc9c26f8cf88cd7fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5fe5ac675540c0930bd7bab0d8b27f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:59.002805 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-26e57ef2-371f-472a-bdd0-d5ac253a57d8 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] 10.222.0.20 "GET /compute/v2.1/servers/5348eee1-b615-4ef5-a4db-5deec1276724" status: 200 len: 1315 microversion: 2.1 time: 0.261606 Jul 30 04:58:59.010077 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 56/102] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:58:58 2022] GET /compute/v2.1/servers/5348eee1-b615-4ef5-a4db-5deec1276724 => generated 1315 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:58:59.355826 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-427eee84-f254-4152-9751-5bec491059c4 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:59.363553 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-427eee84-f254-4152-9751-5bec491059c4 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:59.365056 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-427eee84-f254-4152-9751-5bec491059c4 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:59.366835 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-427eee84-f254-4152-9751-5bec491059c4 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1407 microversion: 2.20 time: 0.518614 Jul 30 04:58:59.367859 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 47/103] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 04:58:58 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1407 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 04:58:59.420268 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-fed3b9b8-8827-4c4c-a905-bae92ae2cea5 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:58:59.420909 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-fed3b9b8-8827-4c4c-a905-bae92ae2cea5 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: f27c16ec-7d74-4a2a-9b40-c95455fa8aff] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:58:59.426808 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fed3b9b8-8827-4c4c-a905-bae92ae2cea5 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:59.427256 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fed3b9b8-8827-4c4c-a905-bae92ae2cea5 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:59.428024 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fed3b9b8-8827-4c4c-a905-bae92ae2cea5 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:59.428609 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fed3b9b8-8827-4c4c-a905-bae92ae2cea5 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:59.455784 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-fe20dd76-24f5-424f-9596-b4d8fe20376e tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:58:59.456429 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-fe20dd76-24f5-424f-9596-b4d8fe20376e tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 7b5e218d-8660-4d90-90d1-9c8e50a66a7c] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:58:59.465241 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-fe20dd76-24f5-424f-9596-b4d8fe20376e tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:59.465693 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-fe20dd76-24f5-424f-9596-b4d8fe20376e tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:59.466488 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-fe20dd76-24f5-424f-9596-b4d8fe20376e tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:58:59.466927 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-fe20dd76-24f5-424f-9596-b4d8fe20376e tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:58:59.579099 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-fed3b9b8-8827-4c4c-a905-bae92ae2cea5 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8abb58f9c274e568d2d0fe3d4df11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01500cb03c74d1082090cd1c1836169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:59.592062 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-fed3b9b8-8827-4c4c-a905-bae92ae2cea5 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff" status: 200 len: 1366 microversion: 2.1 time: 0.175470 Jul 30 04:58:59.592883 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 57/104] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:58:59 2022] GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff => generated 1366 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:58:59.624222 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-fe20dd76-24f5-424f-9596-b4d8fe20376e tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:58:59.633013 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-fe20dd76-24f5-424f-9596-b4d8fe20376e tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c" status: 200 len: 1322 microversion: 2.1 time: 0.182403 Jul 30 04:58:59.633615 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 48/105] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:58:59 2022] GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c => generated 1322 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 04:59:00.036822 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-a7defddf-a0e4-4538-83cd-99b6aed81700 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:00.037433 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-a7defddf-a0e4-4538-83cd-99b6aed81700 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] [instance: 5348eee1-b615-4ef5-a4db-5deec1276724] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:00.063515 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a7defddf-a0e4-4538-83cd-99b6aed81700 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:00.063925 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a7defddf-a0e4-4538-83cd-99b6aed81700 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:00.068055 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a7defddf-a0e4-4538-83cd-99b6aed81700 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:00.068978 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a7defddf-a0e4-4538-83cd-99b6aed81700 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:00.348497 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-a7defddf-a0e4-4538-83cd-99b6aed81700 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691a9c5e4d534dcc9c26f8cf88cd7fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5fe5ac675540c0930bd7bab0d8b27f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:00.365351 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-a7defddf-a0e4-4538-83cd-99b6aed81700 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] 10.222.0.20 "GET /compute/v2.1/servers/5348eee1-b615-4ef5-a4db-5deec1276724" status: 200 len: 1315 microversion: 2.1 time: 0.332134 Jul 30 04:59:00.374603 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 58/106] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:59:00 2022] GET /compute/v2.1/servers/5348eee1-b615-4ef5-a4db-5deec1276724 => generated 1315 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:59:00.393194 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-d65a4ec9-f7ce-4089-aa75-d0e50eb18275 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:00.393964 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-d65a4ec9-f7ce-4089-aa75-d0e50eb18275 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:00.395990 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell0:SELECT=2 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 04:59:00.419442 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d65a4ec9-f7ce-4089-aa75-d0e50eb18275 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:00.420939 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d65a4ec9-f7ce-4089-aa75-d0e50eb18275 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:00.421868 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d65a4ec9-f7ce-4089-aa75-d0e50eb18275 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:00.422644 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d65a4ec9-f7ce-4089-aa75-d0e50eb18275 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:00.614268 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-a8965680-811e-47f8-b518-65e84a4c7ca6 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:00.614922 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-a8965680-811e-47f8-b518-65e84a4c7ca6 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: f27c16ec-7d74-4a2a-9b40-c95455fa8aff] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:00.628335 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a8965680-811e-47f8-b518-65e84a4c7ca6 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:00.628796 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a8965680-811e-47f8-b518-65e84a4c7ca6 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:00.629573 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a8965680-811e-47f8-b518-65e84a4c7ca6 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:00.630013 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a8965680-811e-47f8-b518-65e84a4c7ca6 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:00.653363 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-d65a4ec9-f7ce-4089-aa75-d0e50eb18275 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:00.664262 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-d65a4ec9-f7ce-4089-aa75-d0e50eb18275 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:00.668983 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-d65a4ec9-f7ce-4089-aa75-d0e50eb18275 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:00.670889 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-d65a4ec9-f7ce-4089-aa75-d0e50eb18275 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1407 microversion: 2.20 time: 0.282538 Jul 30 04:59:00.679683 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 49/107] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 04:59:00 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1407 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 04:59:00.685943 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-a2814718-2153-44fa-9312-1af9763d0649 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:00.691180 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-a2814718-2153-44fa-9312-1af9763d0649 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 7b5e218d-8660-4d90-90d1-9c8e50a66a7c] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:00.699738 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a2814718-2153-44fa-9312-1af9763d0649 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:00.701082 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a2814718-2153-44fa-9312-1af9763d0649 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:00.702556 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a2814718-2153-44fa-9312-1af9763d0649 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:00.704100 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a2814718-2153-44fa-9312-1af9763d0649 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:00.883430 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-a8965680-811e-47f8-b518-65e84a4c7ca6 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8abb58f9c274e568d2d0fe3d4df11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01500cb03c74d1082090cd1c1836169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:00.908388 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-a8965680-811e-47f8-b518-65e84a4c7ca6 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff" status: 200 len: 1366 microversion: 2.1 time: 0.298806 Jul 30 04:59:00.908842 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 59/108] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:59:00 2022] GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff => generated 1366 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:59:00.949204 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-a2814718-2153-44fa-9312-1af9763d0649 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:00.962216 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-a2814718-2153-44fa-9312-1af9763d0649 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c" status: 200 len: 1322 microversion: 2.1 time: 0.280489 Jul 30 04:59:00.962951 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 50/109] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:59:00 2022] GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c => generated 1322 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:59:01.387272 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-eaaaa98d-ddda-4a7a-8351-be8138574656 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:01.387908 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-eaaaa98d-ddda-4a7a-8351-be8138574656 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] [instance: 5348eee1-b615-4ef5-a4db-5deec1276724] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:01.394394 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-eaaaa98d-ddda-4a7a-8351-be8138574656 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:01.394865 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-eaaaa98d-ddda-4a7a-8351-be8138574656 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:01.395621 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-eaaaa98d-ddda-4a7a-8351-be8138574656 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:01.396048 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-eaaaa98d-ddda-4a7a-8351-be8138574656 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:01.534301 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-eaaaa98d-ddda-4a7a-8351-be8138574656 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691a9c5e4d534dcc9c26f8cf88cd7fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5fe5ac675540c0930bd7bab0d8b27f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:01.543968 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-eaaaa98d-ddda-4a7a-8351-be8138574656 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] 10.222.0.20 "GET /compute/v2.1/servers/5348eee1-b615-4ef5-a4db-5deec1276724" status: 200 len: 1315 microversion: 2.1 time: 0.160439 Jul 30 04:59:01.544824 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 60/110] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:59:01 2022] GET /compute/v2.1/servers/5348eee1-b615-4ef5-a4db-5deec1276724 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:59:01.695981 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-891d9627-9dd9-40a9-8187-3523bfed63c5 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:01.696841 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-891d9627-9dd9-40a9-8187-3523bfed63c5 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:01.703082 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-891d9627-9dd9-40a9-8187-3523bfed63c5 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:01.703520 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-891d9627-9dd9-40a9-8187-3523bfed63c5 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:01.704453 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-891d9627-9dd9-40a9-8187-3523bfed63c5 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:01.704886 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-891d9627-9dd9-40a9-8187-3523bfed63c5 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:01.870600 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-891d9627-9dd9-40a9-8187-3523bfed63c5 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:01.879131 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-891d9627-9dd9-40a9-8187-3523bfed63c5 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:01.880734 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-891d9627-9dd9-40a9-8187-3523bfed63c5 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:01.881953 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-891d9627-9dd9-40a9-8187-3523bfed63c5 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1407 microversion: 2.20 time: 0.190984 Jul 30 04:59:01.882627 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 51/111] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 04:59:01 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1407 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 04:59:01.929583 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-718ad02b-1029-4834-874e-cbef1600b14d tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:01.930207 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-718ad02b-1029-4834-874e-cbef1600b14d tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: f27c16ec-7d74-4a2a-9b40-c95455fa8aff] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:01.936260 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-718ad02b-1029-4834-874e-cbef1600b14d tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:01.936738 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-718ad02b-1029-4834-874e-cbef1600b14d tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:01.937639 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-718ad02b-1029-4834-874e-cbef1600b14d tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:01.937936 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-718ad02b-1029-4834-874e-cbef1600b14d tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:01.941935 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=100 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 04:59:01.985577 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-1be51de9-c639-447b-9427-a5011c1a9976 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:01.986062 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-1be51de9-c639-447b-9427-a5011c1a9976 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 7b5e218d-8660-4d90-90d1-9c8e50a66a7c] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:01.992897 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1be51de9-c639-447b-9427-a5011c1a9976 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:01.993359 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1be51de9-c639-447b-9427-a5011c1a9976 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:01.994139 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1be51de9-c639-447b-9427-a5011c1a9976 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:01.994612 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1be51de9-c639-447b-9427-a5011c1a9976 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:02.103108 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-718ad02b-1029-4834-874e-cbef1600b14d tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8abb58f9c274e568d2d0fe3d4df11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01500cb03c74d1082090cd1c1836169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:02.115001 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-718ad02b-1029-4834-874e-cbef1600b14d tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff" status: 200 len: 1366 microversion: 2.1 time: 0.189852 Jul 30 04:59:02.115646 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 61/112] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:59:01 2022] GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff => generated 1366 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:59:02.142714 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-1be51de9-c639-447b-9427-a5011c1a9976 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:02.150702 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-1be51de9-c639-447b-9427-a5011c1a9976 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c" status: 200 len: 1322 microversion: 2.1 time: 0.169186 Jul 30 04:59:02.151295 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 52/113] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:59:01 2022] GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c => generated 1322 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 04:59:02.564887 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-c5d5d16b-4047-477b-9b42-05efee9b5bce tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:02.565576 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-c5d5d16b-4047-477b-9b42-05efee9b5bce tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] [instance: 5348eee1-b615-4ef5-a4db-5deec1276724] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:02.572217 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c5d5d16b-4047-477b-9b42-05efee9b5bce tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:02.572730 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c5d5d16b-4047-477b-9b42-05efee9b5bce tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:02.573570 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c5d5d16b-4047-477b-9b42-05efee9b5bce tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:02.574067 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c5d5d16b-4047-477b-9b42-05efee9b5bce tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:02.711967 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-c5d5d16b-4047-477b-9b42-05efee9b5bce tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691a9c5e4d534dcc9c26f8cf88cd7fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5fe5ac675540c0930bd7bab0d8b27f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:02.719520 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-c5d5d16b-4047-477b-9b42-05efee9b5bce tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] 10.222.0.20 "GET /compute/v2.1/servers/5348eee1-b615-4ef5-a4db-5deec1276724" status: 200 len: 1315 microversion: 2.1 time: 0.158475 Jul 30 04:59:02.720100 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 62/114] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:59:02 2022] GET /compute/v2.1/servers/5348eee1-b615-4ef5-a4db-5deec1276724 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:59:02.905111 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-4684410e-f937-47c7-a10c-ecdd85b739df tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:02.905723 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-4684410e-f937-47c7-a10c-ecdd85b739df tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:02.911586 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4684410e-f937-47c7-a10c-ecdd85b739df tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:02.912033 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4684410e-f937-47c7-a10c-ecdd85b739df tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:02.913532 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4684410e-f937-47c7-a10c-ecdd85b739df tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:02.914146 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4684410e-f937-47c7-a10c-ecdd85b739df tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:03.048657 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-4684410e-f937-47c7-a10c-ecdd85b739df tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:03.057608 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-4684410e-f937-47c7-a10c-ecdd85b739df tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:03.059147 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-4684410e-f937-47c7-a10c-ecdd85b739df tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:03.060258 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-4684410e-f937-47c7-a10c-ecdd85b739df tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1407 microversion: 2.20 time: 0.159490 Jul 30 04:59:03.060969 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 53/115] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 04:59:02 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 04:59:03.137642 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-a081a278-04d2-420b-b39b-fefc39705fe7 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:03.138114 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-a081a278-04d2-420b-b39b-fefc39705fe7 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: f27c16ec-7d74-4a2a-9b40-c95455fa8aff] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:03.144369 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a081a278-04d2-420b-b39b-fefc39705fe7 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:03.144819 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a081a278-04d2-420b-b39b-fefc39705fe7 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:03.145577 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a081a278-04d2-420b-b39b-fefc39705fe7 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:03.146004 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a081a278-04d2-420b-b39b-fefc39705fe7 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:03.172777 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-694d92f0-a2b7-4d7c-a7e3-80f814a8598e tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:03.173472 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-694d92f0-a2b7-4d7c-a7e3-80f814a8598e tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 7b5e218d-8660-4d90-90d1-9c8e50a66a7c] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:03.183375 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-694d92f0-a2b7-4d7c-a7e3-80f814a8598e tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:03.184041 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-694d92f0-a2b7-4d7c-a7e3-80f814a8598e tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:03.184809 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-694d92f0-a2b7-4d7c-a7e3-80f814a8598e tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:03.185385 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-694d92f0-a2b7-4d7c-a7e3-80f814a8598e tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:03.306282 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-a081a278-04d2-420b-b39b-fefc39705fe7 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8abb58f9c274e568d2d0fe3d4df11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01500cb03c74d1082090cd1c1836169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:03.315417 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-a081a278-04d2-420b-b39b-fefc39705fe7 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff" status: 200 len: 1366 microversion: 2.1 time: 0.182070 Jul 30 04:59:03.324034 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 63/116] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:59:03 2022] GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff => generated 1366 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:59:03.332264 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-694d92f0-a2b7-4d7c-a7e3-80f814a8598e tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:03.342003 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-694d92f0-a2b7-4d7c-a7e3-80f814a8598e tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c" status: 200 len: 1322 microversion: 2.1 time: 0.173369 Jul 30 04:59:03.342605 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 54/117] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:59:03 2022] GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c => generated 1322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:59:03.740417 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-f1aec3b3-ea5c-4694-b395-e8b9a33a20a4 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:03.742072 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-f1aec3b3-ea5c-4694-b395-e8b9a33a20a4 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] [instance: 5348eee1-b615-4ef5-a4db-5deec1276724] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:03.752314 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f1aec3b3-ea5c-4694-b395-e8b9a33a20a4 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:03.752717 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f1aec3b3-ea5c-4694-b395-e8b9a33a20a4 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:03.753554 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f1aec3b3-ea5c-4694-b395-e8b9a33a20a4 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:03.753999 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f1aec3b3-ea5c-4694-b395-e8b9a33a20a4 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:03.899299 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-f1aec3b3-ea5c-4694-b395-e8b9a33a20a4 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691a9c5e4d534dcc9c26f8cf88cd7fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5fe5ac675540c0930bd7bab0d8b27f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:03.907713 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-f1aec3b3-ea5c-4694-b395-e8b9a33a20a4 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] 10.222.0.20 "GET /compute/v2.1/servers/5348eee1-b615-4ef5-a4db-5deec1276724" status: 200 len: 1315 microversion: 2.1 time: 0.171128 Jul 30 04:59:03.908286 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 64/118] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:59:03 2022] GET /compute/v2.1/servers/5348eee1-b615-4ef5-a4db-5deec1276724 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:59:04.082397 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-9a4e0056-ed28-4177-a654-8fa7866e7856 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:04.083061 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-9a4e0056-ed28-4177-a654-8fa7866e7856 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:04.088965 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9a4e0056-ed28-4177-a654-8fa7866e7856 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:04.089411 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9a4e0056-ed28-4177-a654-8fa7866e7856 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:04.090245 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9a4e0056-ed28-4177-a654-8fa7866e7856 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:04.090698 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9a4e0056-ed28-4177-a654-8fa7866e7856 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:04.279750 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-9a4e0056-ed28-4177-a654-8fa7866e7856 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:04.288726 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-9a4e0056-ed28-4177-a654-8fa7866e7856 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:04.290252 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-9a4e0056-ed28-4177-a654-8fa7866e7856 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:04.291459 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-9a4e0056-ed28-4177-a654-8fa7866e7856 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1407 microversion: 2.20 time: 0.213002 Jul 30 04:59:04.292175 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 55/119] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 04:59:04 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1407 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 04:59:04.341545 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-937e629a-3775-41c0-b458-19fc8ee62244 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:04.342156 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-937e629a-3775-41c0-b458-19fc8ee62244 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: f27c16ec-7d74-4a2a-9b40-c95455fa8aff] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:04.350888 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-937e629a-3775-41c0-b458-19fc8ee62244 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:04.351759 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-937e629a-3775-41c0-b458-19fc8ee62244 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:04.353117 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-937e629a-3775-41c0-b458-19fc8ee62244 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:04.354528 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-937e629a-3775-41c0-b458-19fc8ee62244 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:04.364239 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-5d3ef317-b4f7-4af5-8d7d-5c0f1e6a3392 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:04.365194 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-5d3ef317-b4f7-4af5-8d7d-5c0f1e6a3392 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 7b5e218d-8660-4d90-90d1-9c8e50a66a7c] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:04.373053 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5d3ef317-b4f7-4af5-8d7d-5c0f1e6a3392 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:04.377913 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5d3ef317-b4f7-4af5-8d7d-5c0f1e6a3392 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:04.382916 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5d3ef317-b4f7-4af5-8d7d-5c0f1e6a3392 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:04.383712 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5d3ef317-b4f7-4af5-8d7d-5c0f1e6a3392 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:04.569951 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-937e629a-3775-41c0-b458-19fc8ee62244 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8abb58f9c274e568d2d0fe3d4df11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01500cb03c74d1082090cd1c1836169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:04.577416 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-937e629a-3775-41c0-b458-19fc8ee62244 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff" status: 200 len: 1366 microversion: 2.1 time: 0.241359 Jul 30 04:59:04.577977 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 65/120] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:59:04 2022] GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff => generated 1366 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:59:04.602426 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-5d3ef317-b4f7-4af5-8d7d-5c0f1e6a3392 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:04.611724 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-5d3ef317-b4f7-4af5-8d7d-5c0f1e6a3392 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c" status: 200 len: 1322 microversion: 2.1 time: 0.252041 Jul 30 04:59:04.612601 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 56/121] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:59:04 2022] GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c => generated 1322 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:59:04.716758 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-6f4e4070-a1e5-4ad4-ad74-05650f59d9ec req-c78b215a-04a3-43be-a4c9-698a14fcf41f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5348eee1-b615-4ef5-a4db-5deec1276724", "name": "network-vif-plugged", "status": "completed", "tag": "c19fc198-7bdb-497c-b40d-78705a7b0ac9"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 04:59:04.727627 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-6f4e4070-a1e5-4ad4-ad74-05650f59d9ec req-c78b215a-04a3-43be-a4c9-698a14fcf41f service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:04.728076 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-6f4e4070-a1e5-4ad4-ad74-05650f59d9ec req-c78b215a-04a3-43be-a4c9-698a14fcf41f service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:04.739237 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-6f4e4070-a1e5-4ad4-ad74-05650f59d9ec req-c78b215a-04a3-43be-a4c9-698a14fcf41f service nova] Creating event network-vif-plugged:c19fc198-7bdb-497c-b40d-78705a7b0ac9 for instance 5348eee1-b615-4ef5-a4db-5deec1276724 on hv-cinder-85127 Jul 30 04:59:04.745255 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-6f4e4070-a1e5-4ad4-ad74-05650f59d9ec req-c78b215a-04a3-43be-a4c9-698a14fcf41f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.164272 Jul 30 04:59:04.745838 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 66/122] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Jul 30 04:59:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 04:59:04.929710 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-9a6c02f7-21c5-4aa5-9047-a171bca52fac tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:04.930326 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-9a6c02f7-21c5-4aa5-9047-a171bca52fac tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] [instance: 5348eee1-b615-4ef5-a4db-5deec1276724] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:04.936713 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9a6c02f7-21c5-4aa5-9047-a171bca52fac tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:04.937158 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9a6c02f7-21c5-4aa5-9047-a171bca52fac tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:04.937914 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9a6c02f7-21c5-4aa5-9047-a171bca52fac tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:04.938350 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9a6c02f7-21c5-4aa5-9047-a171bca52fac tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:05.098035 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-9a6c02f7-21c5-4aa5-9047-a171bca52fac tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691a9c5e4d534dcc9c26f8cf88cd7fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5fe5ac675540c0930bd7bab0d8b27f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:05.107557 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-9a6c02f7-21c5-4aa5-9047-a171bca52fac tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] 10.222.0.20 "GET /compute/v2.1/servers/5348eee1-b615-4ef5-a4db-5deec1276724" status: 200 len: 1315 microversion: 2.1 time: 0.182319 Jul 30 04:59:05.108376 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 57/123] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:59:04 2022] GET /compute/v2.1/servers/5348eee1-b615-4ef5-a4db-5deec1276724 => generated 1315 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:59:05.317092 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-d123d888-e3cc-4183-979b-3ec86febdedd tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:05.317430 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-d123d888-e3cc-4183-979b-3ec86febdedd tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:05.324911 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d123d888-e3cc-4183-979b-3ec86febdedd tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:05.325433 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d123d888-e3cc-4183-979b-3ec86febdedd tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:05.326700 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d123d888-e3cc-4183-979b-3ec86febdedd tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:05.326869 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d123d888-e3cc-4183-979b-3ec86febdedd tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:05.539279 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-d123d888-e3cc-4183-979b-3ec86febdedd tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:05.546284 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-d123d888-e3cc-4183-979b-3ec86febdedd tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:05.548145 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-d123d888-e3cc-4183-979b-3ec86febdedd tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:05.549004 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-d123d888-e3cc-4183-979b-3ec86febdedd tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1407 microversion: 2.20 time: 0.236919 Jul 30 04:59:05.549575 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 67/124] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 04:59:05 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1407 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 04:59:05.602806 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-4f26bc83-cde6-4d66-b17e-161ebf7aa95c tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:05.603909 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-4f26bc83-cde6-4d66-b17e-161ebf7aa95c tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: f27c16ec-7d74-4a2a-9b40-c95455fa8aff] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:05.612185 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4f26bc83-cde6-4d66-b17e-161ebf7aa95c tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:05.612825 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4f26bc83-cde6-4d66-b17e-161ebf7aa95c tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:05.613850 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4f26bc83-cde6-4d66-b17e-161ebf7aa95c tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:05.614538 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4f26bc83-cde6-4d66-b17e-161ebf7aa95c tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:05.633205 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-84363f8b-f7c6-4a66-b02f-733df9d4cfd7 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:05.634096 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-84363f8b-f7c6-4a66-b02f-733df9d4cfd7 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 7b5e218d-8660-4d90-90d1-9c8e50a66a7c] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:05.643910 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-84363f8b-f7c6-4a66-b02f-733df9d4cfd7 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:05.647230 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-84363f8b-f7c6-4a66-b02f-733df9d4cfd7 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:05.649010 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-84363f8b-f7c6-4a66-b02f-733df9d4cfd7 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:05.650599 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-84363f8b-f7c6-4a66-b02f-733df9d4cfd7 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:05.823042 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-4f26bc83-cde6-4d66-b17e-161ebf7aa95c tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8abb58f9c274e568d2d0fe3d4df11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01500cb03c74d1082090cd1c1836169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:05.826364 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell1:SELECT=100 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 04:59:05.830270 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-84363f8b-f7c6-4a66-b02f-733df9d4cfd7 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:05.831647 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-4f26bc83-cde6-4d66-b17e-161ebf7aa95c tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff" status: 200 len: 1366 microversion: 2.1 time: 0.235422 Jul 30 04:59:05.832218 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 58/125] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:59:05 2022] GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff => generated 1366 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:59:05.839856 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-84363f8b-f7c6-4a66-b02f-733df9d4cfd7 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c" status: 200 len: 1322 microversion: 2.1 time: 0.211332 Jul 30 04:59:05.840415 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 68/126] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:59:05 2022] GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c => generated 1322 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:59:06.129068 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-a589c6d6-280c-43a7-bccb-8612b6a1feb7 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:06.129744 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-a589c6d6-280c-43a7-bccb-8612b6a1feb7 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] [instance: 5348eee1-b615-4ef5-a4db-5deec1276724] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:06.137709 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a589c6d6-280c-43a7-bccb-8612b6a1feb7 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:06.138477 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a589c6d6-280c-43a7-bccb-8612b6a1feb7 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:06.139564 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a589c6d6-280c-43a7-bccb-8612b6a1feb7 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:06.140061 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a589c6d6-280c-43a7-bccb-8612b6a1feb7 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:06.285294 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-a589c6d6-280c-43a7-bccb-8612b6a1feb7 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691a9c5e4d534dcc9c26f8cf88cd7fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5fe5ac675540c0930bd7bab0d8b27f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:06.294007 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-a589c6d6-280c-43a7-bccb-8612b6a1feb7 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] 10.222.0.20 "GET /compute/v2.1/servers/5348eee1-b615-4ef5-a4db-5deec1276724" status: 200 len: 1315 microversion: 2.1 time: 0.168677 Jul 30 04:59:06.304738 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 59/127] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:59:06 2022] GET /compute/v2.1/servers/5348eee1-b615-4ef5-a4db-5deec1276724 => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:59:06.576820 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-bc383cab-e49a-4ac2-870b-cf5aa546d2b0 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:06.577848 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-bc383cab-e49a-4ac2-870b-cf5aa546d2b0 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:06.584234 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bc383cab-e49a-4ac2-870b-cf5aa546d2b0 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:06.584959 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bc383cab-e49a-4ac2-870b-cf5aa546d2b0 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:06.586066 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bc383cab-e49a-4ac2-870b-cf5aa546d2b0 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:06.586524 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bc383cab-e49a-4ac2-870b-cf5aa546d2b0 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:06.749664 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-bc383cab-e49a-4ac2-870b-cf5aa546d2b0 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:06.759643 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-bc383cab-e49a-4ac2-870b-cf5aa546d2b0 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:06.761425 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-bc383cab-e49a-4ac2-870b-cf5aa546d2b0 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:06.762546 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-bc383cab-e49a-4ac2-870b-cf5aa546d2b0 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1407 microversion: 2.20 time: 0.190576 Jul 30 04:59:06.766480 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 69/128] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 04:59:06 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1407 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 04:59:06.854049 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-9faff0cc-fad9-470e-bcfc-329dd3b9ac42 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:06.856103 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-9faff0cc-fad9-470e-bcfc-329dd3b9ac42 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: f27c16ec-7d74-4a2a-9b40-c95455fa8aff] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:06.861373 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-558d0462-ba87-4623-b540-ee090b843bf0 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:06.861771 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9faff0cc-fad9-470e-bcfc-329dd3b9ac42 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:06.862025 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-558d0462-ba87-4623-b540-ee090b843bf0 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 7b5e218d-8660-4d90-90d1-9c8e50a66a7c] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:06.862735 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9faff0cc-fad9-470e-bcfc-329dd3b9ac42 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:06.864211 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9faff0cc-fad9-470e-bcfc-329dd3b9ac42 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:06.864779 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9faff0cc-fad9-470e-bcfc-329dd3b9ac42 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:06.869995 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-558d0462-ba87-4623-b540-ee090b843bf0 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:06.870640 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-558d0462-ba87-4623-b540-ee090b843bf0 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:06.871565 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-558d0462-ba87-4623-b540-ee090b843bf0 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:06.872148 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-558d0462-ba87-4623-b540-ee090b843bf0 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:07.013391 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-558d0462-ba87-4623-b540-ee090b843bf0 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:07.016770 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-9faff0cc-fad9-470e-bcfc-329dd3b9ac42 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8abb58f9c274e568d2d0fe3d4df11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01500cb03c74d1082090cd1c1836169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:07.021452 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-558d0462-ba87-4623-b540-ee090b843bf0 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c" status: 200 len: 1322 microversion: 2.1 time: 0.164144 Jul 30 04:59:07.022850 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 70/129] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:59:06 2022] GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 04:59:07.036045 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-9faff0cc-fad9-470e-bcfc-329dd3b9ac42 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff" status: 200 len: 1366 microversion: 2.1 time: 0.186426 Jul 30 04:59:07.036609 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 60/130] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:59:06 2022] GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff => generated 1366 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:59:07.315922 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-4594419b-4ad9-4138-8ca9-5ae6d4182443 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:07.317174 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-4594419b-4ad9-4138-8ca9-5ae6d4182443 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] [instance: 5348eee1-b615-4ef5-a4db-5deec1276724] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:07.346640 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4594419b-4ad9-4138-8ca9-5ae6d4182443 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:07.348469 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4594419b-4ad9-4138-8ca9-5ae6d4182443 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:07.350502 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4594419b-4ad9-4138-8ca9-5ae6d4182443 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:07.351925 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4594419b-4ad9-4138-8ca9-5ae6d4182443 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:07.498654 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-4594419b-4ad9-4138-8ca9-5ae6d4182443 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691a9c5e4d534dcc9c26f8cf88cd7fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5fe5ac675540c0930bd7bab0d8b27f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:07.507129 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-4594419b-4ad9-4138-8ca9-5ae6d4182443 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] 10.222.0.20 "GET /compute/v2.1/servers/5348eee1-b615-4ef5-a4db-5deec1276724" status: 200 len: 1315 microversion: 2.1 time: 0.194963 Jul 30 04:59:07.507712 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 71/131] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:59:07 2022] GET /compute/v2.1/servers/5348eee1-b615-4ef5-a4db-5deec1276724 => generated 1315 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:59:07.788133 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-c3af6d76-2033-4262-8f95-f41b5fb253c9 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:07.789667 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-c3af6d76-2033-4262-8f95-f41b5fb253c9 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:07.799713 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c3af6d76-2033-4262-8f95-f41b5fb253c9 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:07.801834 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c3af6d76-2033-4262-8f95-f41b5fb253c9 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:07.803929 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c3af6d76-2033-4262-8f95-f41b5fb253c9 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:07.804348 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c3af6d76-2033-4262-8f95-f41b5fb253c9 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:07.996864 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-c3af6d76-2033-4262-8f95-f41b5fb253c9 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:08.011857 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-c3af6d76-2033-4262-8f95-f41b5fb253c9 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:08.013748 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-c3af6d76-2033-4262-8f95-f41b5fb253c9 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:08.015203 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-c3af6d76-2033-4262-8f95-f41b5fb253c9 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1407 microversion: 2.20 time: 0.233218 Jul 30 04:59:08.016180 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 61/132] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 04:59:07 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1407 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 04:59:08.046320 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-df38c777-c87b-4efc-916d-8b8772ecad92 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:08.047834 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-df38c777-c87b-4efc-916d-8b8772ecad92 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 7b5e218d-8660-4d90-90d1-9c8e50a66a7c] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:08.054897 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-df38c777-c87b-4efc-916d-8b8772ecad92 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:08.055793 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-df38c777-c87b-4efc-916d-8b8772ecad92 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:08.056833 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-df38c777-c87b-4efc-916d-8b8772ecad92 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:08.057279 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-df38c777-c87b-4efc-916d-8b8772ecad92 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:08.065274 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-a04f944e-6a41-4a1a-a6d3-0aa0fe240f3a tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:08.066314 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-a04f944e-6a41-4a1a-a6d3-0aa0fe240f3a tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: f27c16ec-7d74-4a2a-9b40-c95455fa8aff] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:08.075685 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a04f944e-6a41-4a1a-a6d3-0aa0fe240f3a tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:08.076335 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a04f944e-6a41-4a1a-a6d3-0aa0fe240f3a tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:08.077678 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a04f944e-6a41-4a1a-a6d3-0aa0fe240f3a tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:08.078304 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a04f944e-6a41-4a1a-a6d3-0aa0fe240f3a tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:08.511101 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-a04f944e-6a41-4a1a-a6d3-0aa0fe240f3a tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8abb58f9c274e568d2d0fe3d4df11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01500cb03c74d1082090cd1c1836169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:08.523059 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-a04f944e-6a41-4a1a-a6d3-0aa0fe240f3a tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff" status: 200 len: 1366 microversion: 2.1 time: 0.461432 Jul 30 04:59:08.523965 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 62/133] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:59:08 2022] GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff => generated 1366 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:59:08.529977 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-18be3f96-c02b-473f-a84d-ffbbd3f284bd tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:08.530919 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-18be3f96-c02b-473f-a84d-ffbbd3f284bd tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] [instance: 5348eee1-b615-4ef5-a4db-5deec1276724] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:08.538187 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-18be3f96-c02b-473f-a84d-ffbbd3f284bd tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:08.539045 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-18be3f96-c02b-473f-a84d-ffbbd3f284bd tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:08.540333 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-18be3f96-c02b-473f-a84d-ffbbd3f284bd tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:08.541039 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-18be3f96-c02b-473f-a84d-ffbbd3f284bd tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:08.701313 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-df38c777-c87b-4efc-916d-8b8772ecad92 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:08.710595 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-df38c777-c87b-4efc-916d-8b8772ecad92 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c" status: 200 len: 1322 microversion: 2.1 time: 0.669411 Jul 30 04:59:08.711187 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 72/134] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:59:08 2022] GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c => generated 1322 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:59:08.729671 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-21bffb04-f29a-453e-a9fd-67a4bd990bd7 req-27ab1db2-d385-4739-8b2f-97d66b6c7484 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc0c06a0-156a-4cee-8ff7-92ab582bc4a1", "name": "network-vif-plugged", "status": "completed", "tag": "5f770f5f-036f-49c8-aec8-570d5b12103d"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 04:59:08.738716 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-18be3f96-c02b-473f-a84d-ffbbd3f284bd tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691a9c5e4d534dcc9c26f8cf88cd7fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5fe5ac675540c0930bd7bab0d8b27f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:08.749856 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-18be3f96-c02b-473f-a84d-ffbbd3f284bd tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] 10.222.0.20 "GET /compute/v2.1/servers/5348eee1-b615-4ef5-a4db-5deec1276724" status: 200 len: 1315 microversion: 2.1 time: 0.224357 Jul 30 04:59:08.750806 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 63/135] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:59:08 2022] GET /compute/v2.1/servers/5348eee1-b615-4ef5-a4db-5deec1276724 => generated 1315 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:59:08.756567 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-21bffb04-f29a-453e-a9fd-67a4bd990bd7 req-27ab1db2-d385-4739-8b2f-97d66b6c7484 service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:08.759119 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-21bffb04-f29a-453e-a9fd-67a4bd990bd7 req-27ab1db2-d385-4739-8b2f-97d66b6c7484 service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:08.770927 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-21bffb04-f29a-453e-a9fd-67a4bd990bd7 req-27ab1db2-d385-4739-8b2f-97d66b6c7484 service nova] Creating event network-vif-plugged:5f770f5f-036f-49c8-aec8-570d5b12103d for instance cc0c06a0-156a-4cee-8ff7-92ab582bc4a1 on hv-cinder-85127 Jul 30 04:59:08.776655 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-21bffb04-f29a-453e-a9fd-67a4bd990bd7 req-27ab1db2-d385-4739-8b2f-97d66b6c7484 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050588 Jul 30 04:59:08.777290 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 73/136] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Jul 30 04:59:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 04:59:09.040921 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-6c805d66-57ab-4dc7-b1c6-7fe9fe4b8f77 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:09.041534 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-6c805d66-57ab-4dc7-b1c6-7fe9fe4b8f77 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:09.047826 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6c805d66-57ab-4dc7-b1c6-7fe9fe4b8f77 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:09.048348 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6c805d66-57ab-4dc7-b1c6-7fe9fe4b8f77 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:09.049242 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6c805d66-57ab-4dc7-b1c6-7fe9fe4b8f77 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:09.049680 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6c805d66-57ab-4dc7-b1c6-7fe9fe4b8f77 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:09.182452 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-6c805d66-57ab-4dc7-b1c6-7fe9fe4b8f77 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:09.190517 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-6c805d66-57ab-4dc7-b1c6-7fe9fe4b8f77 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:09.192021 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-6c805d66-57ab-4dc7-b1c6-7fe9fe4b8f77 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:09.193120 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-6c805d66-57ab-4dc7-b1c6-7fe9fe4b8f77 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1407 microversion: 2.20 time: 0.156987 Jul 30 04:59:09.195651 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 64/137] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 04:59:09 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 04:59:09.549275 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-f86f06bf-d00f-4df3-8f42-d5156dfceeda tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:09.550122 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-f86f06bf-d00f-4df3-8f42-d5156dfceeda tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: f27c16ec-7d74-4a2a-9b40-c95455fa8aff] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:09.556363 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f86f06bf-d00f-4df3-8f42-d5156dfceeda tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:09.556818 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f86f06bf-d00f-4df3-8f42-d5156dfceeda tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:09.557575 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f86f06bf-d00f-4df3-8f42-d5156dfceeda tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:09.558011 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f86f06bf-d00f-4df3-8f42-d5156dfceeda tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:09.698825 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-f86f06bf-d00f-4df3-8f42-d5156dfceeda tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8abb58f9c274e568d2d0fe3d4df11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01500cb03c74d1082090cd1c1836169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:09.707740 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-f86f06bf-d00f-4df3-8f42-d5156dfceeda tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff" status: 200 len: 1366 microversion: 2.1 time: 0.163238 Jul 30 04:59:09.708310 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 74/138] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:59:09 2022] GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 04:59:09.731854 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-d765c4d4-a39d-491b-a78a-46c5d82a1386 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:09.732464 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-d765c4d4-a39d-491b-a78a-46c5d82a1386 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 7b5e218d-8660-4d90-90d1-9c8e50a66a7c] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:09.738355 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d765c4d4-a39d-491b-a78a-46c5d82a1386 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:09.738832 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d765c4d4-a39d-491b-a78a-46c5d82a1386 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:09.739586 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d765c4d4-a39d-491b-a78a-46c5d82a1386 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:09.740258 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d765c4d4-a39d-491b-a78a-46c5d82a1386 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:09.770606 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-e40b211d-badb-4563-abf0-040a6b9e439d tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:09.771221 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-e40b211d-badb-4563-abf0-040a6b9e439d tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] [instance: 5348eee1-b615-4ef5-a4db-5deec1276724] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:09.777944 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e40b211d-badb-4563-abf0-040a6b9e439d tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:09.778394 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e40b211d-badb-4563-abf0-040a6b9e439d tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:09.779288 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e40b211d-badb-4563-abf0-040a6b9e439d tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:09.779627 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e40b211d-badb-4563-abf0-040a6b9e439d tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:09.872084 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-d765c4d4-a39d-491b-a78a-46c5d82a1386 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:09.879572 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-d765c4d4-a39d-491b-a78a-46c5d82a1386 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c" status: 200 len: 1322 microversion: 2.1 time: 0.151509 Jul 30 04:59:09.880132 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 65/139] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:59:09 2022] GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:59:09.913109 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-e40b211d-badb-4563-abf0-040a6b9e439d tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691a9c5e4d534dcc9c26f8cf88cd7fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5fe5ac675540c0930bd7bab0d8b27f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:09.920849 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-e40b211d-badb-4563-abf0-040a6b9e439d tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] 10.222.0.20 "GET /compute/v2.1/servers/5348eee1-b615-4ef5-a4db-5deec1276724" status: 200 len: 1315 microversion: 2.1 time: 0.153980 Jul 30 04:59:09.921412 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 75/140] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:59:09 2022] GET /compute/v2.1/servers/5348eee1-b615-4ef5-a4db-5deec1276724 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 04:59:10.217831 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-a2f7531a-7210-4a0f-9609-10a4007203db tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:10.218504 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-a2f7531a-7210-4a0f-9609-10a4007203db tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:10.224598 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a2f7531a-7210-4a0f-9609-10a4007203db tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:10.225869 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a2f7531a-7210-4a0f-9609-10a4007203db tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:10.226532 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a2f7531a-7210-4a0f-9609-10a4007203db tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:10.226975 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a2f7531a-7210-4a0f-9609-10a4007203db tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:10.364064 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-a2f7531a-7210-4a0f-9609-10a4007203db tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:10.372475 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-a2f7531a-7210-4a0f-9609-10a4007203db tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:10.374022 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-a2f7531a-7210-4a0f-9609-10a4007203db tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:10.375167 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-a2f7531a-7210-4a0f-9609-10a4007203db tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1407 microversion: 2.20 time: 0.161248 Jul 30 04:59:10.375722 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 66/141] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 04:59:10 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 04:59:10.728919 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-f1d438b8-8b0d-42da-9d99-6ac8202dc6c4 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:10.729530 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-f1d438b8-8b0d-42da-9d99-6ac8202dc6c4 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: f27c16ec-7d74-4a2a-9b40-c95455fa8aff] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:10.735516 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f1d438b8-8b0d-42da-9d99-6ac8202dc6c4 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:10.735963 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f1d438b8-8b0d-42da-9d99-6ac8202dc6c4 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:10.736724 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f1d438b8-8b0d-42da-9d99-6ac8202dc6c4 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:10.737157 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f1d438b8-8b0d-42da-9d99-6ac8202dc6c4 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:10.870560 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-f1d438b8-8b0d-42da-9d99-6ac8202dc6c4 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8abb58f9c274e568d2d0fe3d4df11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01500cb03c74d1082090cd1c1836169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:10.877854 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-f1d438b8-8b0d-42da-9d99-6ac8202dc6c4 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff" status: 200 len: 1366 microversion: 2.1 time: 0.152769 Jul 30 04:59:10.878418 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 76/142] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:59:10 2022] GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:59:10.901545 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-4448f48e-346d-4b1c-9ffc-6e99d0e0153d tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:10.902145 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-4448f48e-346d-4b1c-9ffc-6e99d0e0153d tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 7b5e218d-8660-4d90-90d1-9c8e50a66a7c] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:10.908128 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4448f48e-346d-4b1c-9ffc-6e99d0e0153d tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:10.908584 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4448f48e-346d-4b1c-9ffc-6e99d0e0153d tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:10.909345 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4448f48e-346d-4b1c-9ffc-6e99d0e0153d tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:10.909785 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4448f48e-346d-4b1c-9ffc-6e99d0e0153d tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:10.942329 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-359ef282-f031-4255-bd34-406c018a5eee tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:10.943066 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-359ef282-f031-4255-bd34-406c018a5eee tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] [instance: 5348eee1-b615-4ef5-a4db-5deec1276724] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:10.949757 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-359ef282-f031-4255-bd34-406c018a5eee tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:10.950203 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-359ef282-f031-4255-bd34-406c018a5eee tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:10.950982 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-359ef282-f031-4255-bd34-406c018a5eee tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:10.951411 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-359ef282-f031-4255-bd34-406c018a5eee tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:11.044875 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-4448f48e-346d-4b1c-9ffc-6e99d0e0153d tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:11.052388 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-4448f48e-346d-4b1c-9ffc-6e99d0e0153d tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c" status: 200 len: 1322 microversion: 2.1 time: 0.154576 Jul 30 04:59:11.053506 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 67/143] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:59:10 2022] GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:59:11.095503 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-359ef282-f031-4255-bd34-406c018a5eee tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691a9c5e4d534dcc9c26f8cf88cd7fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5fe5ac675540c0930bd7bab0d8b27f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:11.104564 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-359ef282-f031-4255-bd34-406c018a5eee tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] 10.222.0.20 "GET /compute/v2.1/servers/5348eee1-b615-4ef5-a4db-5deec1276724" status: 200 len: 1315 microversion: 2.1 time: 0.165949 Jul 30 04:59:11.105454 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 77/144] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:59:10 2022] GET /compute/v2.1/servers/5348eee1-b615-4ef5-a4db-5deec1276724 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 04:59:11.397781 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-407538e3-c327-4260-aca7-cf703a36970c tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:11.398486 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-407538e3-c327-4260-aca7-cf703a36970c tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:11.400705 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_api:SELECT=87 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 04:59:11.406484 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-407538e3-c327-4260-aca7-cf703a36970c tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:11.407060 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-407538e3-c327-4260-aca7-cf703a36970c tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:11.407929 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-407538e3-c327-4260-aca7-cf703a36970c tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:11.408437 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-407538e3-c327-4260-aca7-cf703a36970c tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:11.859537 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-407538e3-c327-4260-aca7-cf703a36970c tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:11.868602 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-407538e3-c327-4260-aca7-cf703a36970c tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:11.870358 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-407538e3-c327-4260-aca7-cf703a36970c tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:11.871478 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-407538e3-c327-4260-aca7-cf703a36970c tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1407 microversion: 2.20 time: 0.478039 Jul 30 04:59:11.872155 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 68/145] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 04:59:11 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1407 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 04:59:11.899433 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-955549d8-7ca5-4dec-a36d-95783b8d8b6b tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:11.900028 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-955549d8-7ca5-4dec-a36d-95783b8d8b6b tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: f27c16ec-7d74-4a2a-9b40-c95455fa8aff] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:11.906209 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-955549d8-7ca5-4dec-a36d-95783b8d8b6b tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:11.906702 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-955549d8-7ca5-4dec-a36d-95783b8d8b6b tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:11.907467 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-955549d8-7ca5-4dec-a36d-95783b8d8b6b tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:11.908039 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-955549d8-7ca5-4dec-a36d-95783b8d8b6b tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:12.074762 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-b764f4f3-1edf-4994-94cc-4044a134d9ee tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:12.075585 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-b764f4f3-1edf-4994-94cc-4044a134d9ee tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 7b5e218d-8660-4d90-90d1-9c8e50a66a7c] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:12.086360 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-955549d8-7ca5-4dec-a36d-95783b8d8b6b tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8abb58f9c274e568d2d0fe3d4df11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01500cb03c74d1082090cd1c1836169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:12.087612 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b764f4f3-1edf-4994-94cc-4044a134d9ee tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:12.088664 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b764f4f3-1edf-4994-94cc-4044a134d9ee tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:12.095060 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b764f4f3-1edf-4994-94cc-4044a134d9ee tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:12.095290 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-955549d8-7ca5-4dec-a36d-95783b8d8b6b tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff" status: 200 len: 1366 microversion: 2.1 time: 0.200276 Jul 30 04:59:12.095840 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b764f4f3-1edf-4994-94cc-4044a134d9ee tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:12.096525 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 78/146] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:59:11 2022] GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff => generated 1366 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:59:12.128347 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-53333fc4-3f41-42ab-9288-418c1727a891 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:12.129011 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-53333fc4-3f41-42ab-9288-418c1727a891 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] [instance: 5348eee1-b615-4ef5-a4db-5deec1276724] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:12.136427 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-53333fc4-3f41-42ab-9288-418c1727a891 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:12.136867 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-53333fc4-3f41-42ab-9288-418c1727a891 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:12.137632 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-53333fc4-3f41-42ab-9288-418c1727a891 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:12.138064 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-53333fc4-3f41-42ab-9288-418c1727a891 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:12.142337 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=100 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 04:59:12.430043 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-53333fc4-3f41-42ab-9288-418c1727a891 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691a9c5e4d534dcc9c26f8cf88cd7fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5fe5ac675540c0930bd7bab0d8b27f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:12.443242 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-53333fc4-3f41-42ab-9288-418c1727a891 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] 10.222.0.20 "GET /compute/v2.1/servers/5348eee1-b615-4ef5-a4db-5deec1276724" status: 200 len: 1315 microversion: 2.1 time: 0.319329 Jul 30 04:59:12.444453 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 79/147] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:59:12 2022] GET /compute/v2.1/servers/5348eee1-b615-4ef5-a4db-5deec1276724 => generated 1315 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 04:59:12.451215 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-de688783-c68e-487b-b5b1-0c8c99226a5c req-cfb539ad-96e7-4583-aa8f-14ad9d4abe12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b5e218d-8660-4d90-90d1-9c8e50a66a7c", "name": "network-vif-plugged", "status": "completed", "tag": "46f49659-6b94-4d15-9602-46c795a35ee9"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 04:59:12.462865 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_api:SELECT=100 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 04:59:12.474284 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-b764f4f3-1edf-4994-94cc-4044a134d9ee tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:12.479225 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-de688783-c68e-487b-b5b1-0c8c99226a5c req-cfb539ad-96e7-4583-aa8f-14ad9d4abe12 service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:12.479735 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-de688783-c68e-487b-b5b1-0c8c99226a5c req-cfb539ad-96e7-4583-aa8f-14ad9d4abe12 service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:12.486784 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-b764f4f3-1edf-4994-94cc-4044a134d9ee tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c" status: 200 len: 1322 microversion: 2.1 time: 0.416086 Jul 30 04:59:12.500885 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 69/148] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:59:12 2022] GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c => generated 1322 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:59:12.510178 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-de688783-c68e-487b-b5b1-0c8c99226a5c req-cfb539ad-96e7-4583-aa8f-14ad9d4abe12 service nova] Creating event network-vif-plugged:46f49659-6b94-4d15-9602-46c795a35ee9 for instance 7b5e218d-8660-4d90-90d1-9c8e50a66a7c on hv-cinder-85127 Jul 30 04:59:12.517914 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-de688783-c68e-487b-b5b1-0c8c99226a5c req-cfb539ad-96e7-4583-aa8f-14ad9d4abe12 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072032 Jul 30 04:59:12.519712 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 80/149] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Jul 30 04:59:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 04:59:12.894877 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-2b86d863-307d-4020-a1e0-97364ad645a2 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:12.896108 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-2b86d863-307d-4020-a1e0-97364ad645a2 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:12.903286 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2b86d863-307d-4020-a1e0-97364ad645a2 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:12.903730 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2b86d863-307d-4020-a1e0-97364ad645a2 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:12.904728 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2b86d863-307d-4020-a1e0-97364ad645a2 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:12.905164 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2b86d863-307d-4020-a1e0-97364ad645a2 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:13.039229 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-2b86d863-307d-4020-a1e0-97364ad645a2 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:13.047295 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-2b86d863-307d-4020-a1e0-97364ad645a2 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:13.048822 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-2b86d863-307d-4020-a1e0-97364ad645a2 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:13.049928 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-2b86d863-307d-4020-a1e0-97364ad645a2 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1407 microversion: 2.20 time: 0.160464 Jul 30 04:59:13.050501 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 70/150] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 04:59:12 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 04:59:13.123223 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-bc989d29-c3ea-47fb-b5bd-8936512baec9 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:13.123919 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-bc989d29-c3ea-47fb-b5bd-8936512baec9 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: f27c16ec-7d74-4a2a-9b40-c95455fa8aff] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:13.129966 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bc989d29-c3ea-47fb-b5bd-8936512baec9 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:13.130409 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bc989d29-c3ea-47fb-b5bd-8936512baec9 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:13.131198 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bc989d29-c3ea-47fb-b5bd-8936512baec9 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:13.131633 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bc989d29-c3ea-47fb-b5bd-8936512baec9 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:13.272124 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-bc989d29-c3ea-47fb-b5bd-8936512baec9 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8abb58f9c274e568d2d0fe3d4df11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01500cb03c74d1082090cd1c1836169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:13.279786 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-bc989d29-c3ea-47fb-b5bd-8936512baec9 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff" status: 200 len: 1366 microversion: 2.1 time: 0.163228 Jul 30 04:59:13.280346 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 81/151] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:59:13 2022] GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:59:13.466597 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-e5964c9c-f5e4-4def-a688-38a59e6e3519 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:13.467290 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-e5964c9c-f5e4-4def-a688-38a59e6e3519 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] [instance: 5348eee1-b615-4ef5-a4db-5deec1276724] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:13.473177 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e5964c9c-f5e4-4def-a688-38a59e6e3519 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:13.473625 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e5964c9c-f5e4-4def-a688-38a59e6e3519 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:13.475218 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e5964c9c-f5e4-4def-a688-38a59e6e3519 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:13.475801 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e5964c9c-f5e4-4def-a688-38a59e6e3519 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:13.509750 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-c8938571-e152-48d3-9886-8b71f70c02a1 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:13.510370 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-c8938571-e152-48d3-9886-8b71f70c02a1 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 7b5e218d-8660-4d90-90d1-9c8e50a66a7c] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:13.516593 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c8938571-e152-48d3-9886-8b71f70c02a1 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:13.517237 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c8938571-e152-48d3-9886-8b71f70c02a1 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:13.518574 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c8938571-e152-48d3-9886-8b71f70c02a1 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:13.519319 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c8938571-e152-48d3-9886-8b71f70c02a1 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:13.638713 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-e5964c9c-f5e4-4def-a688-38a59e6e3519 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691a9c5e4d534dcc9c26f8cf88cd7fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5fe5ac675540c0930bd7bab0d8b27f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:13.647453 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-e5964c9c-f5e4-4def-a688-38a59e6e3519 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] 10.222.0.20 "GET /compute/v2.1/servers/5348eee1-b615-4ef5-a4db-5deec1276724" status: 200 len: 1315 microversion: 2.1 time: 0.185304 Jul 30 04:59:13.648064 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 71/152] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:59:13 2022] GET /compute/v2.1/servers/5348eee1-b615-4ef5-a4db-5deec1276724 => generated 1315 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:59:13.669037 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-c8938571-e152-48d3-9886-8b71f70c02a1 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:13.676751 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-c8938571-e152-48d3-9886-8b71f70c02a1 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c" status: 200 len: 1322 microversion: 2.1 time: 0.171995 Jul 30 04:59:13.677308 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 82/153] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:59:13 2022] GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c => generated 1322 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 04:59:14.073888 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-a609c5a2-5a4a-4cef-a474-406eb217cb6c tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:14.074535 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-a609c5a2-5a4a-4cef-a474-406eb217cb6c tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:14.080436 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a609c5a2-5a4a-4cef-a474-406eb217cb6c tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:14.080882 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a609c5a2-5a4a-4cef-a474-406eb217cb6c tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:14.081656 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a609c5a2-5a4a-4cef-a474-406eb217cb6c tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:14.082081 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a609c5a2-5a4a-4cef-a474-406eb217cb6c tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:14.219152 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-a609c5a2-5a4a-4cef-a474-406eb217cb6c tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:14.227053 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-a609c5a2-5a4a-4cef-a474-406eb217cb6c tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:14.228553 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-a609c5a2-5a4a-4cef-a474-406eb217cb6c tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:14.229642 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-a609c5a2-5a4a-4cef-a474-406eb217cb6c tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1407 microversion: 2.20 time: 0.159694 Jul 30 04:59:14.230194 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 72/154] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 04:59:14 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 04:59:14.301239 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-f926ddbc-372c-4d4a-9719-46efcda4f90b tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:14.301878 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-f926ddbc-372c-4d4a-9719-46efcda4f90b tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: f27c16ec-7d74-4a2a-9b40-c95455fa8aff] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:14.308731 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f926ddbc-372c-4d4a-9719-46efcda4f90b tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:14.309187 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f926ddbc-372c-4d4a-9719-46efcda4f90b tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:14.309956 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f926ddbc-372c-4d4a-9719-46efcda4f90b tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:14.310395 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f926ddbc-372c-4d4a-9719-46efcda4f90b tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:14.443364 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-f926ddbc-372c-4d4a-9719-46efcda4f90b tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8abb58f9c274e568d2d0fe3d4df11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01500cb03c74d1082090cd1c1836169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:14.450701 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-f926ddbc-372c-4d4a-9719-46efcda4f90b tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff" status: 200 len: 1366 microversion: 2.1 time: 0.153290 Jul 30 04:59:14.451266 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 83/155] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:59:14 2022] GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:59:14.534317 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-aeec9683-d844-40db-aa4c-9da4bb5f078a req-40e577ff-3538-485d-b816-fa5ef55b632d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f27c16ec-7d74-4a2a-9b40-c95455fa8aff", "name": "network-vif-plugged", "status": "completed", "tag": "17ee318c-931e-496a-b49d-170e9dd9ad2b"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 04:59:14.544671 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-aeec9683-d844-40db-aa4c-9da4bb5f078a req-40e577ff-3538-485d-b816-fa5ef55b632d service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:14.545111 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-aeec9683-d844-40db-aa4c-9da4bb5f078a req-40e577ff-3538-485d-b816-fa5ef55b632d service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:14.556559 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-aeec9683-d844-40db-aa4c-9da4bb5f078a req-40e577ff-3538-485d-b816-fa5ef55b632d service nova] Creating event network-vif-plugged:17ee318c-931e-496a-b49d-170e9dd9ad2b for instance f27c16ec-7d74-4a2a-9b40-c95455fa8aff on hv-cinder-85127 Jul 30 04:59:14.561715 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-aeec9683-d844-40db-aa4c-9da4bb5f078a req-40e577ff-3538-485d-b816-fa5ef55b632d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031080 Jul 30 04:59:14.562296 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 73/156] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Jul 30 04:59:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 04:59:14.669660 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-adb0d40a-2aeb-4db7-9d46-61246629d299 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:14.670272 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-adb0d40a-2aeb-4db7-9d46-61246629d299 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] [instance: 5348eee1-b615-4ef5-a4db-5deec1276724] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:14.676190 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-adb0d40a-2aeb-4db7-9d46-61246629d299 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:14.676637 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-adb0d40a-2aeb-4db7-9d46-61246629d299 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:14.677394 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-adb0d40a-2aeb-4db7-9d46-61246629d299 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:14.678991 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-adb0d40a-2aeb-4db7-9d46-61246629d299 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:14.698162 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-a9ead9c5-8bcf-4286-8b94-809a58237335 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:14.698810 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-a9ead9c5-8bcf-4286-8b94-809a58237335 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 7b5e218d-8660-4d90-90d1-9c8e50a66a7c] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:14.705467 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a9ead9c5-8bcf-4286-8b94-809a58237335 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:14.705968 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a9ead9c5-8bcf-4286-8b94-809a58237335 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:14.706858 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a9ead9c5-8bcf-4286-8b94-809a58237335 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:14.707295 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a9ead9c5-8bcf-4286-8b94-809a58237335 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:14.816233 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-adb0d40a-2aeb-4db7-9d46-61246629d299 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691a9c5e4d534dcc9c26f8cf88cd7fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5fe5ac675540c0930bd7bab0d8b27f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:14.824306 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-adb0d40a-2aeb-4db7-9d46-61246629d299 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] 10.222.0.20 "GET /compute/v2.1/servers/5348eee1-b615-4ef5-a4db-5deec1276724" status: 200 len: 1315 microversion: 2.1 time: 0.158664 Jul 30 04:59:14.824878 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 84/157] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:59:14 2022] GET /compute/v2.1/servers/5348eee1-b615-4ef5-a4db-5deec1276724 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:59:14.845872 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-a9ead9c5-8bcf-4286-8b94-809a58237335 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:14.853207 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-a9ead9c5-8bcf-4286-8b94-809a58237335 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c" status: 200 len: 1322 microversion: 2.1 time: 0.159389 Jul 30 04:59:14.853753 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 74/158] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:59:14 2022] GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 04:59:15.252309 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-be639794-f784-413f-81fc-dec49c80a1e0 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:15.252913 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-be639794-f784-413f-81fc-dec49c80a1e0 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:15.259426 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-be639794-f784-413f-81fc-dec49c80a1e0 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:15.259900 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-be639794-f784-413f-81fc-dec49c80a1e0 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:15.260660 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-be639794-f784-413f-81fc-dec49c80a1e0 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:15.261117 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-be639794-f784-413f-81fc-dec49c80a1e0 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:15.388254 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-be639794-f784-413f-81fc-dec49c80a1e0 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:15.396062 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-be639794-f784-413f-81fc-dec49c80a1e0 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:15.397573 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-be639794-f784-413f-81fc-dec49c80a1e0 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:15.398689 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-be639794-f784-413f-81fc-dec49c80a1e0 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1407 microversion: 2.20 time: 0.150300 Jul 30 04:59:15.399250 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 85/159] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 04:59:15 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1407 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 04:59:15.470592 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-1555390c-aac0-4adf-b161-c8b3dae2e28f tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:15.471202 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-1555390c-aac0-4adf-b161-c8b3dae2e28f tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: f27c16ec-7d74-4a2a-9b40-c95455fa8aff] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:15.478036 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1555390c-aac0-4adf-b161-c8b3dae2e28f tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:15.478511 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1555390c-aac0-4adf-b161-c8b3dae2e28f tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:15.479267 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1555390c-aac0-4adf-b161-c8b3dae2e28f tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:15.479701 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1555390c-aac0-4adf-b161-c8b3dae2e28f tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:15.606384 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-1555390c-aac0-4adf-b161-c8b3dae2e28f tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8abb58f9c274e568d2d0fe3d4df11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01500cb03c74d1082090cd1c1836169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:15.613629 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-1555390c-aac0-4adf-b161-c8b3dae2e28f tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff" status: 200 len: 1366 microversion: 2.1 time: 0.146840 Jul 30 04:59:15.614186 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 75/160] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:59:15 2022] GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:59:15.845575 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-1b65ccf6-692e-46e8-9fcb-4d6735e75f6f tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:15.846187 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-1b65ccf6-692e-46e8-9fcb-4d6735e75f6f tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] [instance: 5348eee1-b615-4ef5-a4db-5deec1276724] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:15.853130 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1b65ccf6-692e-46e8-9fcb-4d6735e75f6f tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:15.853588 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1b65ccf6-692e-46e8-9fcb-4d6735e75f6f tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:15.854591 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1b65ccf6-692e-46e8-9fcb-4d6735e75f6f tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:15.855063 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1b65ccf6-692e-46e8-9fcb-4d6735e75f6f tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:15.875686 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-80d89260-8375-4b68-b728-e4c23ee31510 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:15.876852 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-80d89260-8375-4b68-b728-e4c23ee31510 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 7b5e218d-8660-4d90-90d1-9c8e50a66a7c] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:15.884372 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-80d89260-8375-4b68-b728-e4c23ee31510 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:15.885069 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-80d89260-8375-4b68-b728-e4c23ee31510 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:15.885845 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-80d89260-8375-4b68-b728-e4c23ee31510 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:15.886281 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-80d89260-8375-4b68-b728-e4c23ee31510 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:15.891723 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell1:SELECT=100 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 04:59:16.036273 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-1b65ccf6-692e-46e8-9fcb-4d6735e75f6f tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691a9c5e4d534dcc9c26f8cf88cd7fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5fe5ac675540c0930bd7bab0d8b27f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:16.052153 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-1b65ccf6-692e-46e8-9fcb-4d6735e75f6f tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] 10.222.0.20 "GET /compute/v2.1/servers/5348eee1-b615-4ef5-a4db-5deec1276724" status: 200 len: 1315 microversion: 2.1 time: 0.209531 Jul 30 04:59:16.052715 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 86/161] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:59:15 2022] GET /compute/v2.1/servers/5348eee1-b615-4ef5-a4db-5deec1276724 => generated 1315 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:59:16.080055 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-80d89260-8375-4b68-b728-e4c23ee31510 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:16.099856 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-80d89260-8375-4b68-b728-e4c23ee31510 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c" status: 200 len: 1322 microversion: 2.1 time: 0.225743 Jul 30 04:59:16.100804 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 76/162] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:59:15 2022] GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c => generated 1322 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:59:16.421231 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-b0bfbf8a-d22a-49fa-80ac-37748d8b2463 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:16.421861 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-b0bfbf8a-d22a-49fa-80ac-37748d8b2463 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:16.428513 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b0bfbf8a-d22a-49fa-80ac-37748d8b2463 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:16.428961 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b0bfbf8a-d22a-49fa-80ac-37748d8b2463 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:16.429708 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b0bfbf8a-d22a-49fa-80ac-37748d8b2463 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:16.430135 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b0bfbf8a-d22a-49fa-80ac-37748d8b2463 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:16.583527 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-b0bfbf8a-d22a-49fa-80ac-37748d8b2463 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:16.594156 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-b0bfbf8a-d22a-49fa-80ac-37748d8b2463 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:16.595879 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-b0bfbf8a-d22a-49fa-80ac-37748d8b2463 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:16.597256 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-b0bfbf8a-d22a-49fa-80ac-37748d8b2463 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1407 microversion: 2.20 time: 0.180105 Jul 30 04:59:16.598244 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 87/163] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 04:59:16 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1407 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 04:59:16.635510 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-2b7958f6-cf43-4d4d-bd71-938dbf538b19 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:16.636214 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-2b7958f6-cf43-4d4d-bd71-938dbf538b19 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: f27c16ec-7d74-4a2a-9b40-c95455fa8aff] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:16.642694 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2b7958f6-cf43-4d4d-bd71-938dbf538b19 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:16.643255 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2b7958f6-cf43-4d4d-bd71-938dbf538b19 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:16.644149 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2b7958f6-cf43-4d4d-bd71-938dbf538b19 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:16.644751 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2b7958f6-cf43-4d4d-bd71-938dbf538b19 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:16.799020 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-2b7958f6-cf43-4d4d-bd71-938dbf538b19 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8abb58f9c274e568d2d0fe3d4df11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01500cb03c74d1082090cd1c1836169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:16.810039 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-2b7958f6-cf43-4d4d-bd71-938dbf538b19 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff" status: 200 len: 1366 microversion: 2.1 time: 0.179431 Jul 30 04:59:16.810577 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 77/164] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:59:16 2022] GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff => generated 1366 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:59:17.074262 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-17240802-8b8b-4322-a96f-751d51e211f6 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:17.075106 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-17240802-8b8b-4322-a96f-751d51e211f6 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] [instance: 5348eee1-b615-4ef5-a4db-5deec1276724] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:17.081820 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-17240802-8b8b-4322-a96f-751d51e211f6 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:17.082888 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-17240802-8b8b-4322-a96f-751d51e211f6 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:17.084649 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-17240802-8b8b-4322-a96f-751d51e211f6 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:17.085318 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-17240802-8b8b-4322-a96f-751d51e211f6 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:17.123797 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-bacd84de-5372-4fbf-85b8-5e5b17b93f1c tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:17.124945 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-bacd84de-5372-4fbf-85b8-5e5b17b93f1c tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 7b5e218d-8660-4d90-90d1-9c8e50a66a7c] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:17.135265 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-bacd84de-5372-4fbf-85b8-5e5b17b93f1c tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:17.135725 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-bacd84de-5372-4fbf-85b8-5e5b17b93f1c tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:17.141595 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-bacd84de-5372-4fbf-85b8-5e5b17b93f1c tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:17.142045 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-bacd84de-5372-4fbf-85b8-5e5b17b93f1c tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:17.227757 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-17240802-8b8b-4322-a96f-751d51e211f6 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691a9c5e4d534dcc9c26f8cf88cd7fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5fe5ac675540c0930bd7bab0d8b27f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:17.235331 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-17240802-8b8b-4322-a96f-751d51e211f6 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] 10.222.0.20 "GET /compute/v2.1/servers/5348eee1-b615-4ef5-a4db-5deec1276724" status: 200 len: 1502 microversion: 2.1 time: 0.165055 Jul 30 04:59:17.235902 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 88/165] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:59:17 2022] GET /compute/v2.1/servers/5348eee1-b615-4ef5-a4db-5deec1276724 => generated 1502 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:59:17.291762 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-bacd84de-5372-4fbf-85b8-5e5b17b93f1c tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:17.302522 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-bacd84de-5372-4fbf-85b8-5e5b17b93f1c tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c" status: 200 len: 1322 microversion: 2.1 time: 0.183523 Jul 30 04:59:17.303214 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 78/166] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:59:17 2022] GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c => generated 1322 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:59:17.623207 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-7dc72fd1-e1e2-4104-88bd-ad2334881aad tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:17.624017 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-7dc72fd1-e1e2-4104-88bd-ad2334881aad tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:17.633708 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7dc72fd1-e1e2-4104-88bd-ad2334881aad tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:17.634742 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7dc72fd1-e1e2-4104-88bd-ad2334881aad tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:17.636477 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7dc72fd1-e1e2-4104-88bd-ad2334881aad tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:17.637145 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7dc72fd1-e1e2-4104-88bd-ad2334881aad tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:17.791255 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-7dc72fd1-e1e2-4104-88bd-ad2334881aad tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:17.800016 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-7dc72fd1-e1e2-4104-88bd-ad2334881aad tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:17.801514 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-7dc72fd1-e1e2-4104-88bd-ad2334881aad tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:17.803298 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-7dc72fd1-e1e2-4104-88bd-ad2334881aad tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1407 microversion: 2.20 time: 0.185324 Jul 30 04:59:17.804073 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 89/167] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 04:59:17 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1407 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 04:59:17.831581 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-66c7b279-6db7-4c26-a6a5-b7b460d52215 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:17.832272 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-66c7b279-6db7-4c26-a6a5-b7b460d52215 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: f27c16ec-7d74-4a2a-9b40-c95455fa8aff] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:17.841582 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-66c7b279-6db7-4c26-a6a5-b7b460d52215 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:17.842027 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-66c7b279-6db7-4c26-a6a5-b7b460d52215 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:17.843118 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-66c7b279-6db7-4c26-a6a5-b7b460d52215 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:17.843556 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-66c7b279-6db7-4c26-a6a5-b7b460d52215 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:17.972150 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-66c7b279-6db7-4c26-a6a5-b7b460d52215 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8abb58f9c274e568d2d0fe3d4df11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01500cb03c74d1082090cd1c1836169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:17.979739 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-66c7b279-6db7-4c26-a6a5-b7b460d52215 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff" status: 200 len: 1366 microversion: 2.1 time: 0.152040 Jul 30 04:59:17.980285 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 79/168] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:59:17 2022] GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:59:18.325131 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-9325ec09-50bc-4e5c-b6a9-050a13d362c7 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:18.326015 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-9325ec09-50bc-4e5c-b6a9-050a13d362c7 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 7b5e218d-8660-4d90-90d1-9c8e50a66a7c] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:18.332501 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9325ec09-50bc-4e5c-b6a9-050a13d362c7 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:18.332952 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9325ec09-50bc-4e5c-b6a9-050a13d362c7 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:18.334491 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9325ec09-50bc-4e5c-b6a9-050a13d362c7 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:18.335288 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9325ec09-50bc-4e5c-b6a9-050a13d362c7 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:18.366469 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-20785a50-35f4-44a8-a0a4-c5d8b32aff3e req-c5afa65d-1fc3-4d25-9be9-8b105ecc3bd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4370e65-bec4-454f-9566-33ff60441229", "name": "network-vif-plugged", "status": "completed", "tag": "77f9d403-dee8-430d-8122-9a468f943da2"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 04:59:18.381481 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-20785a50-35f4-44a8-a0a4-c5d8b32aff3e req-c5afa65d-1fc3-4d25-9be9-8b105ecc3bd1 service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:18.382137 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-20785a50-35f4-44a8-a0a4-c5d8b32aff3e req-c5afa65d-1fc3-4d25-9be9-8b105ecc3bd1 service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:18.395948 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-20785a50-35f4-44a8-a0a4-c5d8b32aff3e req-c5afa65d-1fc3-4d25-9be9-8b105ecc3bd1 service nova] Creating event network-vif-plugged:77f9d403-dee8-430d-8122-9a468f943da2 for instance e4370e65-bec4-454f-9566-33ff60441229 on hv-cinder-85127 Jul 30 04:59:18.404450 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-20785a50-35f4-44a8-a0a4-c5d8b32aff3e req-c5afa65d-1fc3-4d25-9be9-8b105ecc3bd1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042502 Jul 30 04:59:18.405152 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 80/169] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Jul 30 04:59:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 04:59:18.471457 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-9325ec09-50bc-4e5c-b6a9-050a13d362c7 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:18.478978 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-9325ec09-50bc-4e5c-b6a9-050a13d362c7 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c" status: 200 len: 1322 microversion: 2.1 time: 0.157715 Jul 30 04:59:18.479529 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 90/170] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:59:18 2022] GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:59:18.826970 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-e900eba0-d3f2-46e7-8366-efe21d32b137 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:18.827666 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-e900eba0-d3f2-46e7-8366-efe21d32b137 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:18.833825 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e900eba0-d3f2-46e7-8366-efe21d32b137 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:18.834359 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e900eba0-d3f2-46e7-8366-efe21d32b137 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:18.835056 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e900eba0-d3f2-46e7-8366-efe21d32b137 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:18.835496 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e900eba0-d3f2-46e7-8366-efe21d32b137 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:18.968233 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-e900eba0-d3f2-46e7-8366-efe21d32b137 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:18.977086 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-e900eba0-d3f2-46e7-8366-efe21d32b137 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:18.978654 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-e900eba0-d3f2-46e7-8366-efe21d32b137 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:18.979760 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-e900eba0-d3f2-46e7-8366-efe21d32b137 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1407 microversion: 2.20 time: 0.157121 Jul 30 04:59:18.980306 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 81/171] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 04:59:18 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 04:59:19.001051 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-7da3b7c8-30c0-4710-92a5-3b5f66093123 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:19.001667 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-7da3b7c8-30c0-4710-92a5-3b5f66093123 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: f27c16ec-7d74-4a2a-9b40-c95455fa8aff] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:19.009026 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7da3b7c8-30c0-4710-92a5-3b5f66093123 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:19.009475 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7da3b7c8-30c0-4710-92a5-3b5f66093123 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:19.010236 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7da3b7c8-30c0-4710-92a5-3b5f66093123 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:19.010696 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7da3b7c8-30c0-4710-92a5-3b5f66093123 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:19.136024 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-7da3b7c8-30c0-4710-92a5-3b5f66093123 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8abb58f9c274e568d2d0fe3d4df11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01500cb03c74d1082090cd1c1836169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:19.143356 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-7da3b7c8-30c0-4710-92a5-3b5f66093123 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff" status: 200 len: 1366 microversion: 2.1 time: 0.146231 Jul 30 04:59:19.143915 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 91/172] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:59:18 2022] GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:59:19.499103 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-99283204-a868-410d-b22c-4a9fca6885b6 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:19.499710 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-99283204-a868-410d-b22c-4a9fca6885b6 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 7b5e218d-8660-4d90-90d1-9c8e50a66a7c] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:19.506199 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-99283204-a868-410d-b22c-4a9fca6885b6 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:19.506669 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-99283204-a868-410d-b22c-4a9fca6885b6 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:19.507413 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-99283204-a868-410d-b22c-4a9fca6885b6 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:19.507841 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-99283204-a868-410d-b22c-4a9fca6885b6 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:19.632825 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-99283204-a868-410d-b22c-4a9fca6885b6 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:19.640079 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-99283204-a868-410d-b22c-4a9fca6885b6 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c" status: 200 len: 1322 microversion: 2.1 time: 0.144803 Jul 30 04:59:19.640637 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 82/173] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:59:19 2022] GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c => generated 1322 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:59:20.006217 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-fded1529-49a0-4a1e-92c8-0200ae4da43d tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:20.006920 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-fded1529-49a0-4a1e-92c8-0200ae4da43d tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:20.013307 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fded1529-49a0-4a1e-92c8-0200ae4da43d tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:20.013760 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fded1529-49a0-4a1e-92c8-0200ae4da43d tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:20.014557 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fded1529-49a0-4a1e-92c8-0200ae4da43d tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:20.014998 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fded1529-49a0-4a1e-92c8-0200ae4da43d tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:20.146576 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-fded1529-49a0-4a1e-92c8-0200ae4da43d tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:20.154536 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-fded1529-49a0-4a1e-92c8-0200ae4da43d tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:20.156050 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-fded1529-49a0-4a1e-92c8-0200ae4da43d tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:20.157153 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-fded1529-49a0-4a1e-92c8-0200ae4da43d tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1407 microversion: 2.20 time: 0.155733 Jul 30 04:59:20.157859 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 92/174] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 04:59:20 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 04:59:20.164749 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-6446f1b6-9241-49ce-9243-f2e3bcf456ad tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:20.169732 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-6446f1b6-9241-49ce-9243-f2e3bcf456ad tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: f27c16ec-7d74-4a2a-9b40-c95455fa8aff] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:20.175931 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6446f1b6-9241-49ce-9243-f2e3bcf456ad tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:20.176384 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6446f1b6-9241-49ce-9243-f2e3bcf456ad tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:20.177149 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6446f1b6-9241-49ce-9243-f2e3bcf456ad tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:20.178138 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6446f1b6-9241-49ce-9243-f2e3bcf456ad tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:20.315289 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-6446f1b6-9241-49ce-9243-f2e3bcf456ad tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8abb58f9c274e568d2d0fe3d4df11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01500cb03c74d1082090cd1c1836169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:20.323203 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-6446f1b6-9241-49ce-9243-f2e3bcf456ad tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff" status: 200 len: 1366 microversion: 2.1 time: 0.162672 Jul 30 04:59:20.323769 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 83/175] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:59:20 2022] GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:59:20.660216 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-ec2dab0f-c4f0-47c8-ae8a-1962616a8b61 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:20.660757 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-ec2dab0f-c4f0-47c8-ae8a-1962616a8b61 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 7b5e218d-8660-4d90-90d1-9c8e50a66a7c] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:20.667271 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ec2dab0f-c4f0-47c8-ae8a-1962616a8b61 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:20.667711 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ec2dab0f-c4f0-47c8-ae8a-1962616a8b61 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:20.668460 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ec2dab0f-c4f0-47c8-ae8a-1962616a8b61 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:20.668888 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ec2dab0f-c4f0-47c8-ae8a-1962616a8b61 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:20.803387 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-ec2dab0f-c4f0-47c8-ae8a-1962616a8b61 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:20.810647 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-ec2dab0f-c4f0-47c8-ae8a-1962616a8b61 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c" status: 200 len: 1322 microversion: 2.1 time: 0.154266 Jul 30 04:59:20.811205 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 93/176] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:59:20 2022] GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:59:21.181112 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-f9b4c2e3-6236-4c80-9d3e-54b74c7e78df tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:21.181717 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-f9b4c2e3-6236-4c80-9d3e-54b74c7e78df tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:21.187705 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f9b4c2e3-6236-4c80-9d3e-54b74c7e78df tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:21.188148 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f9b4c2e3-6236-4c80-9d3e-54b74c7e78df tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:21.188900 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f9b4c2e3-6236-4c80-9d3e-54b74c7e78df tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:21.189354 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f9b4c2e3-6236-4c80-9d3e-54b74c7e78df tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:21.326681 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-f9b4c2e3-6236-4c80-9d3e-54b74c7e78df tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:21.335303 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-f9b4c2e3-6236-4c80-9d3e-54b74c7e78df tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:21.336815 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-f9b4c2e3-6236-4c80-9d3e-54b74c7e78df tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:21.337917 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-f9b4c2e3-6236-4c80-9d3e-54b74c7e78df tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1407 microversion: 2.20 time: 0.161127 Jul 30 04:59:21.338569 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 84/177] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 04:59:21 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 04:59:21.343841 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-e6552ae3-9638-470f-bc27-d7a98ba0c375 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:21.344626 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-e6552ae3-9638-470f-bc27-d7a98ba0c375 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: f27c16ec-7d74-4a2a-9b40-c95455fa8aff] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:21.351506 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e6552ae3-9638-470f-bc27-d7a98ba0c375 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:21.352077 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e6552ae3-9638-470f-bc27-d7a98ba0c375 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:21.353099 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e6552ae3-9638-470f-bc27-d7a98ba0c375 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:21.353474 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e6552ae3-9638-470f-bc27-d7a98ba0c375 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:21.490811 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-e6552ae3-9638-470f-bc27-d7a98ba0c375 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8abb58f9c274e568d2d0fe3d4df11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01500cb03c74d1082090cd1c1836169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:21.498224 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-e6552ae3-9638-470f-bc27-d7a98ba0c375 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff" status: 200 len: 1366 microversion: 2.1 time: 0.158214 Jul 30 04:59:21.498811 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 94/178] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:59:21 2022] GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:59:21.831274 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-d04c7eaf-3ffc-460e-9864-7decbc21f7b8 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:21.831881 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-d04c7eaf-3ffc-460e-9864-7decbc21f7b8 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 7b5e218d-8660-4d90-90d1-9c8e50a66a7c] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:21.838661 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d04c7eaf-3ffc-460e-9864-7decbc21f7b8 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:21.839111 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d04c7eaf-3ffc-460e-9864-7decbc21f7b8 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:21.839870 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d04c7eaf-3ffc-460e-9864-7decbc21f7b8 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:21.840425 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d04c7eaf-3ffc-460e-9864-7decbc21f7b8 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:21.968622 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-d04c7eaf-3ffc-460e-9864-7decbc21f7b8 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:21.976064 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-d04c7eaf-3ffc-460e-9864-7decbc21f7b8 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c" status: 200 len: 1322 microversion: 2.1 time: 0.148583 Jul 30 04:59:21.976755 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 85/179] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:59:21 2022] GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:59:22.360841 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-eb49072e-c15a-4ece-952b-bb81ff698ee0 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:22.361457 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-eb49072e-c15a-4ece-952b-bb81ff698ee0 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:22.367695 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-eb49072e-c15a-4ece-952b-bb81ff698ee0 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:22.368147 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-eb49072e-c15a-4ece-952b-bb81ff698ee0 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:22.368911 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-eb49072e-c15a-4ece-952b-bb81ff698ee0 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:22.369348 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-eb49072e-c15a-4ece-952b-bb81ff698ee0 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:22.495624 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-eb49072e-c15a-4ece-952b-bb81ff698ee0 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:22.503409 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-eb49072e-c15a-4ece-952b-bb81ff698ee0 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:22.504914 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-eb49072e-c15a-4ece-952b-bb81ff698ee0 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:22.506133 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-eb49072e-c15a-4ece-952b-bb81ff698ee0 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1407 microversion: 2.20 time: 0.149194 Jul 30 04:59:22.506729 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 95/180] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 04:59:22 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1407 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 04:59:22.519602 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-5d5c6dfa-197c-4c6f-bd5c-9314e59be913 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:22.520237 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-5d5c6dfa-197c-4c6f-bd5c-9314e59be913 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: f27c16ec-7d74-4a2a-9b40-c95455fa8aff] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:22.526829 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5d5c6dfa-197c-4c6f-bd5c-9314e59be913 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:22.527278 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5d5c6dfa-197c-4c6f-bd5c-9314e59be913 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:22.528026 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5d5c6dfa-197c-4c6f-bd5c-9314e59be913 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:22.528448 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5d5c6dfa-197c-4c6f-bd5c-9314e59be913 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:22.659261 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-5d5c6dfa-197c-4c6f-bd5c-9314e59be913 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8abb58f9c274e568d2d0fe3d4df11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01500cb03c74d1082090cd1c1836169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:22.666583 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-5d5c6dfa-197c-4c6f-bd5c-9314e59be913 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff" status: 200 len: 1366 microversion: 2.1 time: 0.150752 Jul 30 04:59:22.667145 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 86/181] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:59:22 2022] GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:59:22.997062 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-6c85081d-e1f4-4db6-b3d6-3ea3571e9732 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:22.997762 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-6c85081d-e1f4-4db6-b3d6-3ea3571e9732 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 7b5e218d-8660-4d90-90d1-9c8e50a66a7c] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:23.003822 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6c85081d-e1f4-4db6-b3d6-3ea3571e9732 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:23.004276 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6c85081d-e1f4-4db6-b3d6-3ea3571e9732 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:23.005035 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6c85081d-e1f4-4db6-b3d6-3ea3571e9732 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:23.005476 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6c85081d-e1f4-4db6-b3d6-3ea3571e9732 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:23.024783 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=100 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 04:59:23.135831 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-6c85081d-e1f4-4db6-b3d6-3ea3571e9732 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:23.143301 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-6c85081d-e1f4-4db6-b3d6-3ea3571e9732 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c" status: 200 len: 1322 microversion: 2.1 time: 0.150004 Jul 30 04:59:23.143863 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 96/182] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:59:22 2022] GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 04:59:23.529001 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-d62d2e75-85d0-4101-9548-bf178557abd0 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:23.529626 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-d62d2e75-85d0-4101-9548-bf178557abd0 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:23.536056 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d62d2e75-85d0-4101-9548-bf178557abd0 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:23.536538 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d62d2e75-85d0-4101-9548-bf178557abd0 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:23.537371 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d62d2e75-85d0-4101-9548-bf178557abd0 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:23.537810 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d62d2e75-85d0-4101-9548-bf178557abd0 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:23.671992 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-d62d2e75-85d0-4101-9548-bf178557abd0 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:23.680383 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-d62d2e75-85d0-4101-9548-bf178557abd0 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:23.681949 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-d62d2e75-85d0-4101-9548-bf178557abd0 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:23.683114 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-d62d2e75-85d0-4101-9548-bf178557abd0 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1407 microversion: 2.20 time: 0.157904 Jul 30 04:59:23.683664 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 87/183] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 04:59:23 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 04:59:23.687509 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-64b8ff88-129c-4655-94e8-9b44e8befe90 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:23.688121 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-64b8ff88-129c-4655-94e8-9b44e8befe90 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: f27c16ec-7d74-4a2a-9b40-c95455fa8aff] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:23.694593 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-64b8ff88-129c-4655-94e8-9b44e8befe90 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:23.695058 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-64b8ff88-129c-4655-94e8-9b44e8befe90 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:23.695789 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-64b8ff88-129c-4655-94e8-9b44e8befe90 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:23.696217 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-64b8ff88-129c-4655-94e8-9b44e8befe90 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:23.838702 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-64b8ff88-129c-4655-94e8-9b44e8befe90 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8abb58f9c274e568d2d0fe3d4df11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01500cb03c74d1082090cd1c1836169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:23.865026 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-64b8ff88-129c-4655-94e8-9b44e8befe90 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff" status: 200 len: 1366 microversion: 2.1 time: 0.178112 Jul 30 04:59:23.867978 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 97/184] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:59:23 2022] GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff => generated 1366 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 04:59:24.026274 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-f3c15129-c51e-417c-98b4-2c739964f831 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b72d833a-ae3f-4516-9200-054fea523281"}} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 04:59:24.028720 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-f3c15129-c51e-417c-98b4-2c739964f831 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] [instance: 5348eee1-b615-4ef5-a4db-5deec1276724] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:24.034929 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f3c15129-c51e-417c-98b4-2c739964f831 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:24.035388 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f3c15129-c51e-417c-98b4-2c739964f831 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:24.036157 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f3c15129-c51e-417c-98b4-2c739964f831 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:24.036629 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f3c15129-c51e-417c-98b4-2c739964f831 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:24.166526 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-aeecc59f-c42d-4e38-82b0-12f896625ebe tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:24.167833 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-aeecc59f-c42d-4e38-82b0-12f896625ebe tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 7b5e218d-8660-4d90-90d1-9c8e50a66a7c] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:24.176758 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-aeecc59f-c42d-4e38-82b0-12f896625ebe tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:24.178557 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-aeecc59f-c42d-4e38-82b0-12f896625ebe tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:24.180079 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-aeecc59f-c42d-4e38-82b0-12f896625ebe tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:24.180944 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-aeecc59f-c42d-4e38-82b0-12f896625ebe tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:24.340556 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-aeecc59f-c42d-4e38-82b0-12f896625ebe tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:24.349626 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-aeecc59f-c42d-4e38-82b0-12f896625ebe tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c" status: 200 len: 1322 microversion: 2.1 time: 0.188637 Jul 30 04:59:24.350519 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 98/185] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:59:24 2022] GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c => generated 1322 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 04:59:24.705136 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-fc4082cb-0637-4fdd-b283-40f3f606ea7c tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:24.705742 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-fc4082cb-0637-4fdd-b283-40f3f606ea7c tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:24.712145 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fc4082cb-0637-4fdd-b283-40f3f606ea7c tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:24.712798 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fc4082cb-0637-4fdd-b283-40f3f606ea7c tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:24.713558 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fc4082cb-0637-4fdd-b283-40f3f606ea7c tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:24.713994 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fc4082cb-0637-4fdd-b283-40f3f606ea7c tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:24.850952 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-fc4082cb-0637-4fdd-b283-40f3f606ea7c tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:24.859949 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-fc4082cb-0637-4fdd-b283-40f3f606ea7c tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:24.861585 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-fc4082cb-0637-4fdd-b283-40f3f606ea7c tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:24.862838 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-fc4082cb-0637-4fdd-b283-40f3f606ea7c tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1407 microversion: 2.20 time: 0.161556 Jul 30 04:59:24.863397 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 99/186] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 04:59:24 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 04:59:24.887807 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-9dd3fba4-de2c-46d8-9911-cb5bcaf56c2b tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:24.888414 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-9dd3fba4-de2c-46d8-9911-cb5bcaf56c2b tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: f27c16ec-7d74-4a2a-9b40-c95455fa8aff] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:24.894423 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9dd3fba4-de2c-46d8-9911-cb5bcaf56c2b tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:24.894883 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9dd3fba4-de2c-46d8-9911-cb5bcaf56c2b tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:24.896375 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9dd3fba4-de2c-46d8-9911-cb5bcaf56c2b tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:24.897371 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9dd3fba4-de2c-46d8-9911-cb5bcaf56c2b tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:25.059296 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-9dd3fba4-de2c-46d8-9911-cb5bcaf56c2b tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8abb58f9c274e568d2d0fe3d4df11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01500cb03c74d1082090cd1c1836169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:25.069157 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-9dd3fba4-de2c-46d8-9911-cb5bcaf56c2b tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff" status: 200 len: 1366 microversion: 2.1 time: 0.185201 Jul 30 04:59:25.072208 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 100/187] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:59:24 2022] GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff => generated 1366 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 04:59:25.377460 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-b879be5b-66d9-4315-b67e-2fbb01cf1729 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:25.378234 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-b879be5b-66d9-4315-b67e-2fbb01cf1729 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 7b5e218d-8660-4d90-90d1-9c8e50a66a7c] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:25.384747 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b879be5b-66d9-4315-b67e-2fbb01cf1729 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:25.385197 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b879be5b-66d9-4315-b67e-2fbb01cf1729 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:25.386138 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b879be5b-66d9-4315-b67e-2fbb01cf1729 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:25.386915 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b879be5b-66d9-4315-b67e-2fbb01cf1729 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:25.560796 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-b879be5b-66d9-4315-b67e-2fbb01cf1729 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:25.570270 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-b879be5b-66d9-4315-b67e-2fbb01cf1729 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c" status: 200 len: 1516 microversion: 2.1 time: 0.197197 Jul 30 04:59:25.587029 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 101/188] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:59:25 2022] GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c => generated 1516 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:59:25.603315 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-3bda1eba-800b-4a6d-b3c2-c418de78dd16 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 04:59:25.605855 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-3bda1eba-800b-4a6d-b3c2-c418de78dd16 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 7b5e218d-8660-4d90-90d1-9c8e50a66a7c] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:25.628730 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3bda1eba-800b-4a6d-b3c2-c418de78dd16 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:25.636713 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3bda1eba-800b-4a6d-b3c2-c418de78dd16 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:25.637758 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3bda1eba-800b-4a6d-b3c2-c418de78dd16 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:25.638289 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3bda1eba-800b-4a6d-b3c2-c418de78dd16 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:25.718032 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.objects.instance [None req-3bda1eba-800b-4a6d-b3c2-c418de78dd16 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lazy-loading 'flavor' on Instance uuid 7b5e218d-8660-4d90-90d1-9c8e50a66a7c {{(pid=117886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 04:59:25.795372 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-f3c15129-c51e-417c-98b4-2c739964f831 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] 10.222.0.20 "POST /compute/v2.1/servers/5348eee1-b615-4ef5-a4db-5deec1276724/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.777882 Jul 30 04:59:25.799086 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 88/189] 10.222.0.20 () {60 vars in 1323 bytes} [Sat Jul 30 04:59:24 2022] POST /compute/v2.1/servers/5348eee1-b615-4ef5-a4db-5deec1276724/os-volume_attachments => generated 194 bytes in 1784 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 04:59:25.857605 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-3bda1eba-800b-4a6d-b3c2-c418de78dd16 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "POST /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c/action" status: 200 len: 32 microversion: 2.1 time: 0.265773 Jul 30 04:59:25.858549 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 102/190] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Jul 30 04:59:25 2022] POST /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c/action => generated 32 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 30 04:59:25.872649 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-92b97e00-8b0b-431f-b58f-e865219cd38f tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:25.873441 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-92b97e00-8b0b-431f-b58f-e865219cd38f tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 7b5e218d-8660-4d90-90d1-9c8e50a66a7c] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:25.882192 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-92b97e00-8b0b-431f-b58f-e865219cd38f tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:25.882982 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-92b97e00-8b0b-431f-b58f-e865219cd38f tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:25.884071 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-92b97e00-8b0b-431f-b58f-e865219cd38f tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:25.884696 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-92b97e00-8b0b-431f-b58f-e865219cd38f tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:25.887751 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-c4a150e7-f7cd-4294-92d9-a3b4c30782d0 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:25.888455 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-c4a150e7-f7cd-4294-92d9-a3b4c30782d0 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:25.896562 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c4a150e7-f7cd-4294-92d9-a3b4c30782d0 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:25.896998 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c4a150e7-f7cd-4294-92d9-a3b4c30782d0 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:25.898073 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c4a150e7-f7cd-4294-92d9-a3b4c30782d0 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:25.898615 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c4a150e7-f7cd-4294-92d9-a3b4c30782d0 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:26.048423 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-c4a150e7-f7cd-4294-92d9-a3b4c30782d0 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:26.059697 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-c4a150e7-f7cd-4294-92d9-a3b4c30782d0 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:26.061227 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-c4a150e7-f7cd-4294-92d9-a3b4c30782d0 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:26.062338 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-c4a150e7-f7cd-4294-92d9-a3b4c30782d0 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1407 microversion: 2.20 time: 0.179237 Jul 30 04:59:26.075502 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 103/191] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 04:59:25 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1407 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 04:59:26.098210 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-0b0eece8-c6d5-4c68-bc2d-d1a66b4c829e tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:26.098905 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-0b0eece8-c6d5-4c68-bc2d-d1a66b4c829e tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: f27c16ec-7d74-4a2a-9b40-c95455fa8aff] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:26.107359 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0b0eece8-c6d5-4c68-bc2d-d1a66b4c829e tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:26.108104 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0b0eece8-c6d5-4c68-bc2d-d1a66b4c829e tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:26.109180 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0b0eece8-c6d5-4c68-bc2d-d1a66b4c829e tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:26.110000 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0b0eece8-c6d5-4c68-bc2d-d1a66b4c829e tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:26.129093 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-92b97e00-8b0b-431f-b58f-e865219cd38f tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:26.138725 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-92b97e00-8b0b-431f-b58f-e865219cd38f tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c" status: 200 len: 1522 microversion: 2.1 time: 0.272842 Jul 30 04:59:26.145085 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 89/192] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:59:25 2022] GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c => generated 1522 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:59:26.339023 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-0b0eece8-c6d5-4c68-bc2d-d1a66b4c829e tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8abb58f9c274e568d2d0fe3d4df11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01500cb03c74d1082090cd1c1836169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:26.346263 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-0b0eece8-c6d5-4c68-bc2d-d1a66b4c829e tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff" status: 200 len: 1555 microversion: 2.1 time: 0.253866 Jul 30 04:59:26.346916 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 104/193] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:59:26 2022] GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff => generated 1555 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:59:26.368621 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-2537c537-8ec3-4263-9ac6-a2d89bdb2fef tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:26.369113 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-2537c537-8ec3-4263-9ac6-a2d89bdb2fef tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: f27c16ec-7d74-4a2a-9b40-c95455fa8aff] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:26.375041 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2537c537-8ec3-4263-9ac6-a2d89bdb2fef tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:26.375532 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2537c537-8ec3-4263-9ac6-a2d89bdb2fef tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:26.376299 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2537c537-8ec3-4263-9ac6-a2d89bdb2fef tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:26.376735 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2537c537-8ec3-4263-9ac6-a2d89bdb2fef tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:26.460626 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-2537c537-8ec3-4263-9ac6-a2d89bdb2fef tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095998 Jul 30 04:59:26.461220 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 90/194] 10.222.0.20 () {58 vars in 1275 bytes} [Sat Jul 30 04:59:26 2022] GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 04:59:27.087274 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-6aa2be98-678b-415a-84a3-76fed9fd6534 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:27.088755 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-6aa2be98-678b-415a-84a3-76fed9fd6534 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:27.096377 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6aa2be98-678b-415a-84a3-76fed9fd6534 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:27.097024 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6aa2be98-678b-415a-84a3-76fed9fd6534 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:27.097941 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6aa2be98-678b-415a-84a3-76fed9fd6534 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:27.098549 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6aa2be98-678b-415a-84a3-76fed9fd6534 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:27.165914 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-50cdf061-b519-45b5-9291-98156ce71516 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:27.167946 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-50cdf061-b519-45b5-9291-98156ce71516 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 7b5e218d-8660-4d90-90d1-9c8e50a66a7c] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:27.176051 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-50cdf061-b519-45b5-9291-98156ce71516 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:27.176714 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-50cdf061-b519-45b5-9291-98156ce71516 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:27.178005 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-50cdf061-b519-45b5-9291-98156ce71516 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:27.179969 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-50cdf061-b519-45b5-9291-98156ce71516 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:27.421354 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-50cdf061-b519-45b5-9291-98156ce71516 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:27.443311 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-50cdf061-b519-45b5-9291-98156ce71516 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c" status: 200 len: 1522 microversion: 2.1 time: 0.279524 Jul 30 04:59:27.459260 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 91/195] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:59:27 2022] GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c => generated 1522 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 04:59:27.713507 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-6aa2be98-678b-415a-84a3-76fed9fd6534 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:27.723244 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-6aa2be98-678b-415a-84a3-76fed9fd6534 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:27.725684 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-6aa2be98-678b-415a-84a3-76fed9fd6534 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:27.727072 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-6aa2be98-678b-415a-84a3-76fed9fd6534 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1407 microversion: 2.20 time: 0.644362 Jul 30 04:59:27.728218 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 105/196] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 04:59:27 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1407 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 04:59:28.250728 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-c36ccdd8-4681-4989-af29-5376100a44c4 req-6f7cee09-57b6-4cf6-bcdb-1e47ae1dbb97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f27c16ec-7d74-4a2a-9b40-c95455fa8aff", "tag": "17ee318c-931e-496a-b49d-170e9dd9ad2b"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 04:59:28.273509 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-c36ccdd8-4681-4989-af29-5376100a44c4 req-6f7cee09-57b6-4cf6-bcdb-1e47ae1dbb97 service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:28.274691 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-c36ccdd8-4681-4989-af29-5376100a44c4 req-6f7cee09-57b6-4cf6-bcdb-1e47ae1dbb97 service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:28.298167 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-c36ccdd8-4681-4989-af29-5376100a44c4 req-6f7cee09-57b6-4cf6-bcdb-1e47ae1dbb97 service nova] Creating event network-changed:17ee318c-931e-496a-b49d-170e9dd9ad2b for instance f27c16ec-7d74-4a2a-9b40-c95455fa8aff on hv-cinder-85127 Jul 30 04:59:28.310656 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-c36ccdd8-4681-4989-af29-5376100a44c4 req-6f7cee09-57b6-4cf6-bcdb-1e47ae1dbb97 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064611 Jul 30 04:59:28.319521 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 92/197] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Jul 30 04:59:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 04:59:28.465284 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-f7075cda-9b2d-4eec-9a5e-3644575f5c81 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:28.466361 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-f7075cda-9b2d-4eec-9a5e-3644575f5c81 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 7b5e218d-8660-4d90-90d1-9c8e50a66a7c] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:28.477862 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f7075cda-9b2d-4eec-9a5e-3644575f5c81 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:28.478309 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f7075cda-9b2d-4eec-9a5e-3644575f5c81 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:28.479657 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f7075cda-9b2d-4eec-9a5e-3644575f5c81 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:28.480665 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f7075cda-9b2d-4eec-9a5e-3644575f5c81 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:28.755518 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-e88fb941-4ae8-49a2-a469-c3f1a378e954 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:28.756514 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-e88fb941-4ae8-49a2-a469-c3f1a378e954 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:28.767277 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e88fb941-4ae8-49a2-a469-c3f1a378e954 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:28.767980 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e88fb941-4ae8-49a2-a469-c3f1a378e954 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:28.774851 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e88fb941-4ae8-49a2-a469-c3f1a378e954 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:28.775657 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e88fb941-4ae8-49a2-a469-c3f1a378e954 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:28.783985 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 04:59:28.886552 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-f7075cda-9b2d-4eec-9a5e-3644575f5c81 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:28.900021 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-f7075cda-9b2d-4eec-9a5e-3644575f5c81 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c" status: 200 len: 1522 microversion: 2.1 time: 0.437446 Jul 30 04:59:28.912859 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 106/198] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:59:28 2022] GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c => generated 1522 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:59:29.282819 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-e88fb941-4ae8-49a2-a469-c3f1a378e954 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:29.302900 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-e88fb941-4ae8-49a2-a469-c3f1a378e954 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:29.305078 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-e88fb941-4ae8-49a2-a469-c3f1a378e954 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:29.306654 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-e88fb941-4ae8-49a2-a469-c3f1a378e954 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1599 microversion: 2.20 time: 0.556834 Jul 30 04:59:29.323624 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 93/199] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 04:59:28 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1599 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 04:59:29.333191 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-f0fda7bc-4cbb-483d-be86-30c4dd3d2d59 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:29.334348 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-f0fda7bc-4cbb-483d-be86-30c4dd3d2d59 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:29.348846 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f0fda7bc-4cbb-483d-be86-30c4dd3d2d59 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:29.349440 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f0fda7bc-4cbb-483d-be86-30c4dd3d2d59 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:29.350092 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f0fda7bc-4cbb-483d-be86-30c4dd3d2d59 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:29.350546 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f0fda7bc-4cbb-483d-be86-30c4dd3d2d59 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:29.460891 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-f0fda7bc-4cbb-483d-be86-30c4dd3d2d59 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.132525 Jul 30 04:59:29.462513 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 107/200] 10.222.0.20 () {60 vars in 1316 bytes} [Sat Jul 30 04:59:29 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229/os-interface => generated 284 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 04:59:29.928423 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-1c440e4b-5f88-4f7a-b57b-91ba65310f4a tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:29.929152 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-1c440e4b-5f88-4f7a-b57b-91ba65310f4a tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 7b5e218d-8660-4d90-90d1-9c8e50a66a7c] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:29.943630 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1c440e4b-5f88-4f7a-b57b-91ba65310f4a tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:29.944221 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1c440e4b-5f88-4f7a-b57b-91ba65310f4a tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:29.946333 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1c440e4b-5f88-4f7a-b57b-91ba65310f4a tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:29.947223 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1c440e4b-5f88-4f7a-b57b-91ba65310f4a tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:30.337097 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-1c440e4b-5f88-4f7a-b57b-91ba65310f4a tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:30.347518 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-1c440e4b-5f88-4f7a-b57b-91ba65310f4a tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c" status: 200 len: 1522 microversion: 2.1 time: 0.424308 Jul 30 04:59:30.348191 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 94/201] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:59:29 2022] GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c => generated 1522 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 04:59:30.885232 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-236dc1dd-66c6-4806-8ef3-dca59cd96bcf req-0f1e1279-d565-40d0-8c4e-2ec4631f64da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4370e65-bec4-454f-9566-33ff60441229", "tag": "77f9d403-dee8-430d-8122-9a468f943da2"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 04:59:30.899215 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-236dc1dd-66c6-4806-8ef3-dca59cd96bcf req-0f1e1279-d565-40d0-8c4e-2ec4631f64da service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:30.900363 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-236dc1dd-66c6-4806-8ef3-dca59cd96bcf req-0f1e1279-d565-40d0-8c4e-2ec4631f64da service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:30.921437 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-236dc1dd-66c6-4806-8ef3-dca59cd96bcf req-0f1e1279-d565-40d0-8c4e-2ec4631f64da service nova] Creating event network-changed:77f9d403-dee8-430d-8122-9a468f943da2 for instance e4370e65-bec4-454f-9566-33ff60441229 on hv-cinder-85127 Jul 30 04:59:30.930246 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-236dc1dd-66c6-4806-8ef3-dca59cd96bcf req-0f1e1279-d565-40d0-8c4e-2ec4631f64da service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050695 Jul 30 04:59:30.931316 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 108/202] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Jul 30 04:59:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 04:59:31.372793 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-9b47456c-5957-4c25-a172-0ce718b82d46 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:31.373410 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-9b47456c-5957-4c25-a172-0ce718b82d46 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 7b5e218d-8660-4d90-90d1-9c8e50a66a7c] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:31.391490 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9b47456c-5957-4c25-a172-0ce718b82d46 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:31.396500 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9b47456c-5957-4c25-a172-0ce718b82d46 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:31.399165 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9b47456c-5957-4c25-a172-0ce718b82d46 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:31.402372 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9b47456c-5957-4c25-a172-0ce718b82d46 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:31.697586 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-9b47456c-5957-4c25-a172-0ce718b82d46 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:31.708160 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-9b47456c-5957-4c25-a172-0ce718b82d46 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c" status: 200 len: 1522 microversion: 2.1 time: 0.339027 Jul 30 04:59:31.724634 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 95/203] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:59:31 2022] GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c => generated 1522 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:59:32.732591 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-c7c21b2d-5a42-4009-b28b-b556ebfa4d19 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:32.733319 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-c7c21b2d-5a42-4009-b28b-b556ebfa4d19 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 7b5e218d-8660-4d90-90d1-9c8e50a66a7c] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:32.749982 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c7c21b2d-5a42-4009-b28b-b556ebfa4d19 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:32.751637 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c7c21b2d-5a42-4009-b28b-b556ebfa4d19 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:32.752677 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c7c21b2d-5a42-4009-b28b-b556ebfa4d19 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:32.754622 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c7c21b2d-5a42-4009-b28b-b556ebfa4d19 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:33.389565 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-c7c21b2d-5a42-4009-b28b-b556ebfa4d19 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:33.420327 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-c7c21b2d-5a42-4009-b28b-b556ebfa4d19 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c" status: 200 len: 1522 microversion: 2.1 time: 0.693507 Jul 30 04:59:33.420918 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 109/204] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:59:32 2022] GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c => generated 1522 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:59:34.441583 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-2e00d38e-66ea-4815-9c8d-d4437781aa56 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:34.443171 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-2e00d38e-66ea-4815-9c8d-d4437781aa56 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 7b5e218d-8660-4d90-90d1-9c8e50a66a7c] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:34.453709 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2e00d38e-66ea-4815-9c8d-d4437781aa56 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:34.454170 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2e00d38e-66ea-4815-9c8d-d4437781aa56 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:34.455290 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2e00d38e-66ea-4815-9c8d-d4437781aa56 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:34.455826 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2e00d38e-66ea-4815-9c8d-d4437781aa56 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:34.633586 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-2e00d38e-66ea-4815-9c8d-d4437781aa56 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:34.643146 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-2e00d38e-66ea-4815-9c8d-d4437781aa56 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c" status: 200 len: 1522 microversion: 2.1 time: 0.205514 Jul 30 04:59:34.644292 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 96/205] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:59:34 2022] GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c => generated 1522 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:59:35.666567 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-4f98522c-5ac3-4d3a-950e-6bdd27b85a12 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:35.667195 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-4f98522c-5ac3-4d3a-950e-6bdd27b85a12 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 7b5e218d-8660-4d90-90d1-9c8e50a66a7c] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:35.680911 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4f98522c-5ac3-4d3a-950e-6bdd27b85a12 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:35.685458 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4f98522c-5ac3-4d3a-950e-6bdd27b85a12 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:35.689328 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4f98522c-5ac3-4d3a-950e-6bdd27b85a12 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:35.690744 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4f98522c-5ac3-4d3a-950e-6bdd27b85a12 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:36.134651 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-4f98522c-5ac3-4d3a-950e-6bdd27b85a12 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:36.144481 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-4f98522c-5ac3-4d3a-950e-6bdd27b85a12 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c" status: 200 len: 1522 microversion: 2.1 time: 0.482602 Jul 30 04:59:36.159241 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 110/206] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:59:35 2022] GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c => generated 1522 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:59:37.168900 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-3516f9e9-807c-4159-812b-96d0ddf60a99 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:37.170250 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-3516f9e9-807c-4159-812b-96d0ddf60a99 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 7b5e218d-8660-4d90-90d1-9c8e50a66a7c] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:37.181300 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3516f9e9-807c-4159-812b-96d0ddf60a99 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:37.189584 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3516f9e9-807c-4159-812b-96d0ddf60a99 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:37.196813 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3516f9e9-807c-4159-812b-96d0ddf60a99 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:37.197993 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3516f9e9-807c-4159-812b-96d0ddf60a99 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:37.224112 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-3067021d-ad9e-46dc-879b-f88c7e992dc2 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:37.226005 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-3067021d-ad9e-46dc-879b-f88c7e992dc2 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] [instance: 5348eee1-b615-4ef5-a4db-5deec1276724] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:37.252073 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3067021d-ad9e-46dc-879b-f88c7e992dc2 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:37.258902 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3067021d-ad9e-46dc-879b-f88c7e992dc2 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:37.259803 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3067021d-ad9e-46dc-879b-f88c7e992dc2 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:37.260252 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3067021d-ad9e-46dc-879b-f88c7e992dc2 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:37.311383 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-3067021d-ad9e-46dc-879b-f88c7e992dc2 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] [instance: 5348eee1-b615-4ef5-a4db-5deec1276724] Going to try to terminate instance {{(pid=117886) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 04:59:37.365649 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 04:59:37.519340 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-3067021d-ad9e-46dc-879b-f88c7e992dc2 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5348eee1-b615-4ef5-a4db-5deec1276724" status: 204 len: 0 microversion: 2.1 time: 0.304529 Jul 30 04:59:37.524140 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 111/207] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Jul 30 04:59:37 2022] DELETE /compute/v2.1/servers/5348eee1-b615-4ef5-a4db-5deec1276724 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 04:59:37.530416 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-51303c48-6a63-4f3a-9cd1-887672f6f593 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:37.532365 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-51303c48-6a63-4f3a-9cd1-887672f6f593 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] [instance: 5348eee1-b615-4ef5-a4db-5deec1276724] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:37.539888 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-51303c48-6a63-4f3a-9cd1-887672f6f593 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:37.540945 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-51303c48-6a63-4f3a-9cd1-887672f6f593 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:37.541911 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-51303c48-6a63-4f3a-9cd1-887672f6f593 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:37.542551 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-51303c48-6a63-4f3a-9cd1-887672f6f593 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:37.542677 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-3516f9e9-807c-4159-812b-96d0ddf60a99 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:37.555145 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-3516f9e9-807c-4159-812b-96d0ddf60a99 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c" status: 200 len: 1522 microversion: 2.1 time: 0.390786 Jul 30 04:59:37.555747 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 97/208] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:59:37 2022] GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c => generated 1522 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:59:37.978978 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-51303c48-6a63-4f3a-9cd1-887672f6f593 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691a9c5e4d534dcc9c26f8cf88cd7fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5fe5ac675540c0930bd7bab0d8b27f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:37.993873 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-51303c48-6a63-4f3a-9cd1-887672f6f593 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] 10.222.0.20 "GET /compute/v2.1/servers/5348eee1-b615-4ef5-a4db-5deec1276724" status: 200 len: 1554 microversion: 2.1 time: 0.468254 Jul 30 04:59:38.014632 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 112/209] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:59:37 2022] GET /compute/v2.1/servers/5348eee1-b615-4ef5-a4db-5deec1276724 => generated 1554 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:59:38.585330 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-e2de61d8-30f1-4dbc-a107-d6e025baf5f3 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:38.585950 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-e2de61d8-30f1-4dbc-a107-d6e025baf5f3 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 7b5e218d-8660-4d90-90d1-9c8e50a66a7c] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:38.602286 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e2de61d8-30f1-4dbc-a107-d6e025baf5f3 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:38.602768 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e2de61d8-30f1-4dbc-a107-d6e025baf5f3 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:38.603549 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e2de61d8-30f1-4dbc-a107-d6e025baf5f3 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:38.603983 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e2de61d8-30f1-4dbc-a107-d6e025baf5f3 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:38.809284 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-e2de61d8-30f1-4dbc-a107-d6e025baf5f3 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:38.818150 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-e2de61d8-30f1-4dbc-a107-d6e025baf5f3 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c" status: 200 len: 1522 microversion: 2.1 time: 0.240872 Jul 30 04:59:38.833638 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 98/210] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:59:38 2022] GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c => generated 1522 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:59:39.016375 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-4c430711-62be-4c0b-aa32-052c076bbc7d tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:39.017514 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-4c430711-62be-4c0b-aa32-052c076bbc7d tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] [instance: 5348eee1-b615-4ef5-a4db-5deec1276724] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:39.024864 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4c430711-62be-4c0b-aa32-052c076bbc7d tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:39.025310 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4c430711-62be-4c0b-aa32-052c076bbc7d tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:39.026079 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4c430711-62be-4c0b-aa32-052c076bbc7d tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:39.026526 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4c430711-62be-4c0b-aa32-052c076bbc7d tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:39.177701 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-4c430711-62be-4c0b-aa32-052c076bbc7d tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691a9c5e4d534dcc9c26f8cf88cd7fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5fe5ac675540c0930bd7bab0d8b27f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:39.186345 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-4c430711-62be-4c0b-aa32-052c076bbc7d tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] 10.222.0.20 "GET /compute/v2.1/servers/5348eee1-b615-4ef5-a4db-5deec1276724" status: 200 len: 1554 microversion: 2.1 time: 0.173658 Jul 30 04:59:39.188244 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 113/211] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:59:39 2022] GET /compute/v2.1/servers/5348eee1-b615-4ef5-a4db-5deec1276724 => generated 1554 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:59:39.843874 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-f73f14ed-4d3c-4418-b227-842dc0ed9815 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:39.845119 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-f73f14ed-4d3c-4418-b227-842dc0ed9815 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 7b5e218d-8660-4d90-90d1-9c8e50a66a7c] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:39.853117 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f73f14ed-4d3c-4418-b227-842dc0ed9815 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:39.853834 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f73f14ed-4d3c-4418-b227-842dc0ed9815 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:39.854801 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f73f14ed-4d3c-4418-b227-842dc0ed9815 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:39.855388 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f73f14ed-4d3c-4418-b227-842dc0ed9815 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:40.014525 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-f73f14ed-4d3c-4418-b227-842dc0ed9815 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:40.025338 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-f73f14ed-4d3c-4418-b227-842dc0ed9815 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c" status: 200 len: 1522 microversion: 2.1 time: 0.185243 Jul 30 04:59:40.026587 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 99/212] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:59:39 2022] GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:59:40.211944 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-2ab44de4-91a4-48d0-ba1d-83db25eba16d tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:40.212562 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-2ab44de4-91a4-48d0-ba1d-83db25eba16d tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] [instance: 5348eee1-b615-4ef5-a4db-5deec1276724] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:40.219167 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2ab44de4-91a4-48d0-ba1d-83db25eba16d tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:40.219606 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2ab44de4-91a4-48d0-ba1d-83db25eba16d tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:40.220421 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2ab44de4-91a4-48d0-ba1d-83db25eba16d tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:40.221067 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2ab44de4-91a4-48d0-ba1d-83db25eba16d tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:40.462216 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-2ab44de4-91a4-48d0-ba1d-83db25eba16d tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691a9c5e4d534dcc9c26f8cf88cd7fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5fe5ac675540c0930bd7bab0d8b27f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:40.471193 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-2ab44de4-91a4-48d0-ba1d-83db25eba16d tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] 10.222.0.20 "GET /compute/v2.1/servers/5348eee1-b615-4ef5-a4db-5deec1276724" status: 200 len: 1554 microversion: 2.1 time: 0.264696 Jul 30 04:59:40.476365 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 114/213] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:59:40 2022] GET /compute/v2.1/servers/5348eee1-b615-4ef5-a4db-5deec1276724 => generated 1554 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:59:41.052908 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-cacd81c9-81ec-4586-b92e-a5a494c79288 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:41.053630 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-cacd81c9-81ec-4586-b92e-a5a494c79288 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 7b5e218d-8660-4d90-90d1-9c8e50a66a7c] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:41.061857 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-cacd81c9-81ec-4586-b92e-a5a494c79288 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:41.062298 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-cacd81c9-81ec-4586-b92e-a5a494c79288 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:41.063175 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-cacd81c9-81ec-4586-b92e-a5a494c79288 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:41.066900 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-cacd81c9-81ec-4586-b92e-a5a494c79288 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:41.234326 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-cacd81c9-81ec-4586-b92e-a5a494c79288 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:41.242809 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-cacd81c9-81ec-4586-b92e-a5a494c79288 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c" status: 200 len: 1522 microversion: 2.1 time: 0.195004 Jul 30 04:59:41.243395 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 100/214] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:59:41 2022] GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:59:41.493460 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-11516b37-fffc-4e59-be05-82595aea0ca9 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:41.494706 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-11516b37-fffc-4e59-be05-82595aea0ca9 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] [instance: 5348eee1-b615-4ef5-a4db-5deec1276724] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:41.501626 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-11516b37-fffc-4e59-be05-82595aea0ca9 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:41.502178 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-11516b37-fffc-4e59-be05-82595aea0ca9 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:41.503051 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-11516b37-fffc-4e59-be05-82595aea0ca9 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:41.503557 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-11516b37-fffc-4e59-be05-82595aea0ca9 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:41.844057 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-11516b37-fffc-4e59-be05-82595aea0ca9 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691a9c5e4d534dcc9c26f8cf88cd7fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5fe5ac675540c0930bd7bab0d8b27f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:41.855972 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-11516b37-fffc-4e59-be05-82595aea0ca9 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] 10.222.0.20 "GET /compute/v2.1/servers/5348eee1-b615-4ef5-a4db-5deec1276724" status: 200 len: 1554 microversion: 2.1 time: 0.367461 Jul 30 04:59:41.869109 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 115/215] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:59:41 2022] GET /compute/v2.1/servers/5348eee1-b615-4ef5-a4db-5deec1276724 => generated 1554 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:59:42.265138 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-a3d5eb03-0ff7-47e0-99c0-d693426f29b1 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:42.265951 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-a3d5eb03-0ff7-47e0-99c0-d693426f29b1 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 7b5e218d-8660-4d90-90d1-9c8e50a66a7c] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:42.268423 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_api:SELECT=66 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 04:59:42.274374 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a3d5eb03-0ff7-47e0-99c0-d693426f29b1 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:42.274881 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a3d5eb03-0ff7-47e0-99c0-d693426f29b1 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:42.275659 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a3d5eb03-0ff7-47e0-99c0-d693426f29b1 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:42.276279 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a3d5eb03-0ff7-47e0-99c0-d693426f29b1 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:42.708687 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-a3d5eb03-0ff7-47e0-99c0-d693426f29b1 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:42.727909 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-a3d5eb03-0ff7-47e0-99c0-d693426f29b1 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c" status: 200 len: 1522 microversion: 2.1 time: 0.466571 Jul 30 04:59:42.729829 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 101/216] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:59:42 2022] GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c => generated 1522 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:59:42.879577 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-b9a6bff0-3165-47e2-994f-ec266a7de802 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:42.880333 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-b9a6bff0-3165-47e2-994f-ec266a7de802 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] [instance: 5348eee1-b615-4ef5-a4db-5deec1276724] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:42.891163 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 04:59:42.892701 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b9a6bff0-3165-47e2-994f-ec266a7de802 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:42.893152 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b9a6bff0-3165-47e2-994f-ec266a7de802 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:42.893977 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b9a6bff0-3165-47e2-994f-ec266a7de802 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:42.894351 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b9a6bff0-3165-47e2-994f-ec266a7de802 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:43.117618 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-b9a6bff0-3165-47e2-994f-ec266a7de802 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691a9c5e4d534dcc9c26f8cf88cd7fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5fe5ac675540c0930bd7bab0d8b27f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:43.128690 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-b9a6bff0-3165-47e2-994f-ec266a7de802 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] 10.222.0.20 "GET /compute/v2.1/servers/5348eee1-b615-4ef5-a4db-5deec1276724" status: 200 len: 1554 microversion: 2.1 time: 0.253145 Jul 30 04:59:43.143092 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 116/217] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:59:42 2022] GET /compute/v2.1/servers/5348eee1-b615-4ef5-a4db-5deec1276724 => generated 1554 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:59:43.761122 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-bd33bbf2-8a90-4967-856c-2d8b8ed6bea1 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:43.762383 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-bd33bbf2-8a90-4967-856c-2d8b8ed6bea1 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 7b5e218d-8660-4d90-90d1-9c8e50a66a7c] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:43.777044 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-bd33bbf2-8a90-4967-856c-2d8b8ed6bea1 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:43.777554 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-bd33bbf2-8a90-4967-856c-2d8b8ed6bea1 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:43.795261 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-bd33bbf2-8a90-4967-856c-2d8b8ed6bea1 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:43.797219 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-bd33bbf2-8a90-4967-856c-2d8b8ed6bea1 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:44.151504 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-2bd875d8-4980-4c0b-a65f-36b580a6664d tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:44.152228 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-2bd875d8-4980-4c0b-a65f-36b580a6664d tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] [instance: 5348eee1-b615-4ef5-a4db-5deec1276724] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:44.159928 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2bd875d8-4980-4c0b-a65f-36b580a6664d tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:44.161004 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2bd875d8-4980-4c0b-a65f-36b580a6664d tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:44.163910 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2bd875d8-4980-4c0b-a65f-36b580a6664d tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:44.164383 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2bd875d8-4980-4c0b-a65f-36b580a6664d tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:44.232106 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-bd33bbf2-8a90-4967-856c-2d8b8ed6bea1 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:44.259331 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-bd33bbf2-8a90-4967-856c-2d8b8ed6bea1 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c" status: 200 len: 1522 microversion: 2.1 time: 0.506020 Jul 30 04:59:44.259934 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 102/218] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:59:43 2022] GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c => generated 1522 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:59:44.404107 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-2bd875d8-4980-4c0b-a65f-36b580a6664d tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691a9c5e4d534dcc9c26f8cf88cd7fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5fe5ac675540c0930bd7bab0d8b27f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:44.423571 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-2bd875d8-4980-4c0b-a65f-36b580a6664d tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] 10.222.0.20 "GET /compute/v2.1/servers/5348eee1-b615-4ef5-a4db-5deec1276724" status: 200 len: 1554 microversion: 2.1 time: 0.273500 Jul 30 04:59:44.425353 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 117/219] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:59:44 2022] GET /compute/v2.1/servers/5348eee1-b615-4ef5-a4db-5deec1276724 => generated 1554 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 04:59:45.096360 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-e3c5b33f-08dd-4a7f-b695-84b167038427 req-824df1fa-fae0-4618-8e9f-0287aeeb439b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5348eee1-b615-4ef5-a4db-5deec1276724", "name": "network-vif-deleted", "tag": "c19fc198-7bdb-497c-b40d-78705a7b0ac9"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 04:59:45.112122 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-e3c5b33f-08dd-4a7f-b695-84b167038427 req-824df1fa-fae0-4618-8e9f-0287aeeb439b service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:45.112896 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-e3c5b33f-08dd-4a7f-b695-84b167038427 req-824df1fa-fae0-4618-8e9f-0287aeeb439b service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:45.128120 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-e3c5b33f-08dd-4a7f-b695-84b167038427 req-824df1fa-fae0-4618-8e9f-0287aeeb439b service nova] Creating event network-vif-deleted:c19fc198-7bdb-497c-b40d-78705a7b0ac9 for instance 5348eee1-b615-4ef5-a4db-5deec1276724 on hv-cinder-85127 Jul 30 04:59:45.140529 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-e3c5b33f-08dd-4a7f-b695-84b167038427 req-824df1fa-fae0-4618-8e9f-0287aeeb439b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047749 Jul 30 04:59:45.141663 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 118/220] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Jul 30 04:59:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 04:59:45.281558 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-e037b268-d6ca-45c2-981d-b1e39404ccb7 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:45.282697 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-e037b268-d6ca-45c2-981d-b1e39404ccb7 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 7b5e218d-8660-4d90-90d1-9c8e50a66a7c] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:45.290926 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e037b268-d6ca-45c2-981d-b1e39404ccb7 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:45.291454 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e037b268-d6ca-45c2-981d-b1e39404ccb7 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:45.292415 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e037b268-d6ca-45c2-981d-b1e39404ccb7 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:45.292730 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e037b268-d6ca-45c2-981d-b1e39404ccb7 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:45.297669 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-a54ead3d-392f-4779-bacc-3dd0e7bbe3a6 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Action: 'create', calling method: .version_select at 0x7f2db56851f0>, body: {"keypair": {"name": "tempest-TestShelveInstance-157398780", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKdtad7AZsQ0q2lmD97Q87WaoaYfTqh2eztV1/H7Yi/a7rRWIvcRTUoTW6MSSxKQn5Wn4Fx6EKFTv6zWHiKUBKxiR0vU6OdWunANeCKOEYIMpaxpltOdqyQ7Du5Z5eRAEQ=="}} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 04:59:45.314400 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.quota [None req-a54ead3d-392f-4779-bacc-3dd0e7bbe3a6 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Getting quotas for project 76df23454a3c4a9bb4f61b044ed5a426. Resources: {'key_pairs'} {{(pid=117885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 04:59:45.325431 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.quota [None req-a54ead3d-392f-4779-bacc-3dd0e7bbe3a6 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Getting quotas for user b1a98edf8e5a4a22b3ae7d041b582b2d and project 76df23454a3c4a9bb4f61b044ed5a426. Resources: {'key_pairs'} {{(pid=117885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 04:59:45.363313 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-a54ead3d-392f-4779-bacc-3dd0e7bbe3a6 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.439764 Jul 30 04:59:45.364499 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 103/221] 10.222.0.20 () {60 vars in 1159 bytes} [Sat Jul 30 04:59:44 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 04:59:45.449093 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-287a38ab-826b-4a5b-8010-8d5889f21605 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:45.449447 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-287a38ab-826b-4a5b-8010-8d5889f21605 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] [instance: 5348eee1-b615-4ef5-a4db-5deec1276724] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:45.456375 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-e037b268-d6ca-45c2-981d-b1e39404ccb7 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:45.465873 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-e037b268-d6ca-45c2-981d-b1e39404ccb7 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c" status: 200 len: 1522 microversion: 2.1 time: 0.189225 Jul 30 04:59:45.466802 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 119/222] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:59:45 2022] GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:59:45.469400 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-287a38ab-826b-4a5b-8010-8d5889f21605 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:45.469824 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-287a38ab-826b-4a5b-8010-8d5889f21605 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:45.470646 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-287a38ab-826b-4a5b-8010-8d5889f21605 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:45.471097 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-287a38ab-826b-4a5b-8010-8d5889f21605 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:45.607448 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-287a38ab-826b-4a5b-8010-8d5889f21605 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '691a9c5e4d534dcc9c26f8cf88cd7fb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef5fe5ac675540c0930bd7bab0d8b27f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:45.637279 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-287a38ab-826b-4a5b-8010-8d5889f21605 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] 10.222.0.20 "GET /compute/v2.1/servers/5348eee1-b615-4ef5-a4db-5deec1276724" status: 200 len: 1346 microversion: 2.1 time: 0.191244 Jul 30 04:59:45.639001 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 104/223] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:59:45 2022] GET /compute/v2.1/servers/5348eee1-b615-4ef5-a4db-5deec1276724 => generated 1346 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:59:46.489135 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-21ae67c5-0aba-49ab-a178-15276fcd676a tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:46.490044 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-21ae67c5-0aba-49ab-a178-15276fcd676a tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 7b5e218d-8660-4d90-90d1-9c8e50a66a7c] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:46.496264 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-21ae67c5-0aba-49ab-a178-15276fcd676a tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:46.496717 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-21ae67c5-0aba-49ab-a178-15276fcd676a tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:46.497490 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-21ae67c5-0aba-49ab-a178-15276fcd676a tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:46.497926 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-21ae67c5-0aba-49ab-a178-15276fcd676a tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:46.659504 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-cccd91c6-5fe9-40db-b976-cf4680af3efb tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:46.661137 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-cccd91c6-5fe9-40db-b976-cf4680af3efb tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] [instance: 5348eee1-b615-4ef5-a4db-5deec1276724] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:46.668667 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-cccd91c6-5fe9-40db-b976-cf4680af3efb tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:46.669114 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-cccd91c6-5fe9-40db-b976-cf4680af3efb tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:46.669913 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-cccd91c6-5fe9-40db-b976-cf4680af3efb tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:46.670493 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-cccd91c6-5fe9-40db-b976-cf4680af3efb tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:46.688029 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.wsgi [None req-cccd91c6-5fe9-40db-b976-cf4680af3efb tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] HTTP exception thrown: Instance 5348eee1-b615-4ef5-a4db-5deec1276724 could not be found. Jul 30 04:59:46.696800 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-cccd91c6-5fe9-40db-b976-cf4680af3efb tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Request method failure captured: Jul 30 04:59:46.696800 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: request: GET /compute/v2.1/servers/5348eee1-b615-4ef5-a4db-5deec1276724 HTTP/1.1 Jul 30 04:59:46.696800 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Accept: application/json Jul 30 04:59:46.696800 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Accept-Encoding: identity Jul 30 04:59:46.696800 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Connection: close Jul 30 04:59:46.696800 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Content-Length: 0 Jul 30 04:59:46.696800 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Content-Type: application/json Jul 30 04:59:46.696800 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Host: 10.222.0.20 Jul 30 04:59:46.696800 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Openstack-System-Scope: None Jul 30 04:59:46.696800 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: User-Agent: python-urllib3/1.26.10 Jul 30 04:59:46.696800 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Auth-Token: gAAAAABi5LpuhyHW99TFjplJ7l_QtYlOSzvkQYHSF1nTmA7L4WpI1mR-0XE3ooev0J7TTFGcJWvlk8FQlRKFaXe5lyYudzajYWiSzIERqn8zN3X0y5goNB3wYEsZdJMuGCQLUsEyZLW1mMa3tjp78eS0CZQcOhZH2K3_XGvlkxbmZWM5iCWPHt4 Jul 30 04:59:46.696800 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Domain-Id: None Jul 30 04:59:46.696800 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Domain-Name: None Jul 30 04:59:46.696800 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Identity-Status: Confirmed Jul 30 04:59:46.696800 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Is-Admin-Project: True Jul 30 04:59:46.696800 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Domain-Id: default Jul 30 04:59:46.696800 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Domain-Name: Default Jul 30 04:59:46.696800 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Id: ef5fe5ac675540c0930bd7bab0d8b27f Jul 30 04:59:46.696800 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Name: tempest-DeleteServersTestJSON-1313340388 Jul 30 04:59:46.696800 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Role: member,reader Jul 30 04:59:46.696800 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Roles: member,reader Jul 30 04:59:46.698036 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ef5fe5ac675540c0930bd7bab0d8b27f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ef5fe5ac675540c0930bd7bab0d8b27f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ef5fe5ac675540c0930bd7bab0d8b27f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ef5fe5ac675540c0930bd7bab0d8b27f"}]}] Jul 30 04:59:46.698036 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Tenant: tempest-DeleteServersTestJSON-1313340388 Jul 30 04:59:46.698036 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Tenant-Id: ef5fe5ac675540c0930bd7bab0d8b27f Jul 30 04:59:46.698036 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Tenant-Name: tempest-DeleteServersTestJSON-1313340388 Jul 30 04:59:46.698036 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User: tempest-DeleteServersTestJSON-1313340388-project Jul 30 04:59:46.698036 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Domain-Id: default Jul 30 04:59:46.698036 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Domain-Name: Default Jul 30 04:59:46.698036 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Id: 691a9c5e4d534dcc9c26f8cf88cd7fb5 Jul 30 04:59:46.698036 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Name: tempest-DeleteServersTestJSON-1313340388-project Jul 30 04:59:46.698036 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: method: > Jul 30 04:59:46.698036 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: exception: Instance 5348eee1-b615-4ef5-a4db-5deec1276724 could not be found. Jul 30 04:59:46.698036 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: action_args: {'id': '5348eee1-b615-4ef5-a4db-5deec1276724'} Jul 30 04:59:46.699058 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 04:59:46.699058 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 04:59:46.699058 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 04:59:46.699058 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 04:59:46.699058 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 04:59:46.699058 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 04:59:46.699058 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 04:59:46.699058 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 04:59:46.699058 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 04:59:46.699058 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 04:59:46.699058 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5348eee1-b615-4ef5-a4db-5deec1276724 could not be found. Jul 30 04:59:46.699058 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 04:59:46.699058 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 04:59:46.699058 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 04:59:46.699058 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 04:59:46.699058 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 04:59:46.699058 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 04:59:46.699058 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 04:59:46.699058 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 04:59:46.699058 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 04:59:46.700154 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 04:59:46.700154 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 04:59:46.700154 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 04:59:46.700154 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 04:59:46.700154 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 04:59:46.700154 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 04:59:46.700154 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 04:59:46.700154 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5348eee1-b615-4ef5-a4db-5deec1276724 could not be found. Jul 30 04:59:46.700154 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 04:59:46.700154 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 04:59:46.700154 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 04:59:46.700154 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 04:59:46.700154 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 04:59:46.700154 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 04:59:46.700154 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 04:59:46.700154 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 04:59:46.700154 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5348eee1-b615-4ef5-a4db-5deec1276724 could not be found. Jul 30 04:59:46.700154 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 04:59:46.706802 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-cccd91c6-5fe9-40db-b976-cf4680af3efb tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Returning 404 to user: Instance 5348eee1-b615-4ef5-a4db-5deec1276724 could not be found. {{(pid=117885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 04:59:46.708981 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-cccd91c6-5fe9-40db-b976-cf4680af3efb tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] 10.222.0.20 "GET /compute/v2.1/servers/5348eee1-b615-4ef5-a4db-5deec1276724" status: 404 len: 111 microversion: 2.1 time: 0.053140 Jul 30 04:59:46.724120 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-21ae67c5-0aba-49ab-a178-15276fcd676a tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:46.732313 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 105/224] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:59:46 2022] GET /compute/v2.1/servers/5348eee1-b615-4ef5-a4db-5deec1276724 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 30 04:59:46.737331 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-21ae67c5-0aba-49ab-a178-15276fcd676a tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c" status: 200 len: 1522 microversion: 2.1 time: 0.248386 Jul 30 04:59:46.739213 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 120/225] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:59:46 2022] GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c => generated 1522 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:59:46.856122 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-cc789f31-2974-4b66-b0ca-b3210350fbcc tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:46.858827 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-cc789f31-2974-4b66-b0ca-b3210350fbcc tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] [instance: 5348eee1-b615-4ef5-a4db-5deec1276724] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:46.865909 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-cc789f31-2974-4b66-b0ca-b3210350fbcc tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:46.866507 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-cc789f31-2974-4b66-b0ca-b3210350fbcc tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:46.867525 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-cc789f31-2974-4b66-b0ca-b3210350fbcc tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:46.868163 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-cc789f31-2974-4b66-b0ca-b3210350fbcc tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:46.886261 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.wsgi [None req-cc789f31-2974-4b66-b0ca-b3210350fbcc tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] HTTP exception thrown: Instance 5348eee1-b615-4ef5-a4db-5deec1276724 could not be found. Jul 30 04:59:46.888816 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-cc789f31-2974-4b66-b0ca-b3210350fbcc tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Request method failure captured: Jul 30 04:59:46.888816 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: request: GET /compute/v2.1/servers/5348eee1-b615-4ef5-a4db-5deec1276724/os-volume_attachments HTTP/1.1 Jul 30 04:59:46.888816 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Accept: application/json Jul 30 04:59:46.888816 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Accept-Encoding: identity Jul 30 04:59:46.888816 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Connection: close Jul 30 04:59:46.888816 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Content-Length: 0 Jul 30 04:59:46.888816 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Content-Type: application/json Jul 30 04:59:46.888816 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Host: 10.222.0.20 Jul 30 04:59:46.888816 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Openstack-System-Scope: None Jul 30 04:59:46.888816 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: User-Agent: python-urllib3/1.26.10 Jul 30 04:59:46.888816 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Auth-Token: gAAAAABi5LpuhyHW99TFjplJ7l_QtYlOSzvkQYHSF1nTmA7L4WpI1mR-0XE3ooev0J7TTFGcJWvlk8FQlRKFaXe5lyYudzajYWiSzIERqn8zN3X0y5goNB3wYEsZdJMuGCQLUsEyZLW1mMa3tjp78eS0CZQcOhZH2K3_XGvlkxbmZWM5iCWPHt4 Jul 30 04:59:46.888816 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Domain-Id: None Jul 30 04:59:46.888816 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Domain-Name: None Jul 30 04:59:46.888816 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Identity-Status: Confirmed Jul 30 04:59:46.888816 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Is-Admin-Project: True Jul 30 04:59:46.888816 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Domain-Id: default Jul 30 04:59:46.888816 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Domain-Name: Default Jul 30 04:59:46.888816 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Id: ef5fe5ac675540c0930bd7bab0d8b27f Jul 30 04:59:46.888816 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Name: tempest-DeleteServersTestJSON-1313340388 Jul 30 04:59:46.888816 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Role: member,reader Jul 30 04:59:46.888816 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Roles: member,reader Jul 30 04:59:46.889942 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ef5fe5ac675540c0930bd7bab0d8b27f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ef5fe5ac675540c0930bd7bab0d8b27f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ef5fe5ac675540c0930bd7bab0d8b27f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ef5fe5ac675540c0930bd7bab0d8b27f"}]}] Jul 30 04:59:46.889942 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Tenant: tempest-DeleteServersTestJSON-1313340388 Jul 30 04:59:46.889942 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Tenant-Id: ef5fe5ac675540c0930bd7bab0d8b27f Jul 30 04:59:46.889942 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Tenant-Name: tempest-DeleteServersTestJSON-1313340388 Jul 30 04:59:46.889942 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User: tempest-DeleteServersTestJSON-1313340388-project Jul 30 04:59:46.889942 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Domain-Id: default Jul 30 04:59:46.889942 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Domain-Name: Default Jul 30 04:59:46.889942 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Id: 691a9c5e4d534dcc9c26f8cf88cd7fb5 Jul 30 04:59:46.889942 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Name: tempest-DeleteServersTestJSON-1313340388-project Jul 30 04:59:46.889942 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: method: > Jul 30 04:59:46.889942 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: exception: Instance 5348eee1-b615-4ef5-a4db-5deec1276724 could not be found. Jul 30 04:59:46.889942 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: action_args: {'server_id': '5348eee1-b615-4ef5-a4db-5deec1276724'} Jul 30 04:59:46.890638 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 04:59:46.890638 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 04:59:46.890638 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 04:59:46.890638 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 04:59:46.890638 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 04:59:46.890638 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 04:59:46.890638 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 04:59:46.890638 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 04:59:46.890638 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 04:59:46.890638 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 04:59:46.890638 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5348eee1-b615-4ef5-a4db-5deec1276724 could not be found. Jul 30 04:59:46.890638 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 04:59:46.890638 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 04:59:46.890638 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 04:59:46.890638 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 04:59:46.890638 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 04:59:46.890638 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 04:59:46.890638 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 04:59:46.890638 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 04:59:46.890638 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 04:59:46.891679 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 04:59:46.891679 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 30 04:59:46.891679 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 04:59:46.891679 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 30 04:59:46.891679 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 04:59:46.891679 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 30 04:59:46.891679 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 30 04:59:46.891679 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 04:59:46.891679 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 04:59:46.891679 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5348eee1-b615-4ef5-a4db-5deec1276724 could not be found. Jul 30 04:59:46.891679 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 04:59:46.891679 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 04:59:46.891679 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 04:59:46.891679 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 04:59:46.891679 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 04:59:46.891679 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 04:59:46.891679 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 04:59:46.891679 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 04:59:46.891679 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5348eee1-b615-4ef5-a4db-5deec1276724 could not be found. Jul 30 04:59:46.891679 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 04:59:46.895343 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-cc789f31-2974-4b66-b0ca-b3210350fbcc tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Returning 404 to user: Instance 5348eee1-b615-4ef5-a4db-5deec1276724 could not be found. {{(pid=117885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 04:59:46.896570 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-cc789f31-2974-4b66-b0ca-b3210350fbcc tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] 10.222.0.20 "GET /compute/v2.1/servers/5348eee1-b615-4ef5-a4db-5deec1276724/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.044904 Jul 30 04:59:46.900793 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 106/226] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Jul 30 04:59:46 2022] GET /compute/v2.1/servers/5348eee1-b615-4ef5-a4db-5deec1276724/os-volume_attachments => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 04:59:47.764333 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-d89b6a28-8e44-42b2-bb3b-1293bdd6790b tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:47.764947 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-d89b6a28-8e44-42b2-bb3b-1293bdd6790b tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 7b5e218d-8660-4d90-90d1-9c8e50a66a7c] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:47.771647 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d89b6a28-8e44-42b2-bb3b-1293bdd6790b tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:47.772096 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d89b6a28-8e44-42b2-bb3b-1293bdd6790b tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:47.772877 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d89b6a28-8e44-42b2-bb3b-1293bdd6790b tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:47.773312 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d89b6a28-8e44-42b2-bb3b-1293bdd6790b tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:47.921654 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-d89b6a28-8e44-42b2-bb3b-1293bdd6790b tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:47.929460 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-d89b6a28-8e44-42b2-bb3b-1293bdd6790b tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c" status: 200 len: 1522 microversion: 2.1 time: 0.169020 Jul 30 04:59:47.930030 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 121/227] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:59:47 2022] GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:59:48.391525 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-6015b4d3-42b7-4da2-a8e9-f3e815e0cd76 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:48.392249 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-6015b4d3-42b7-4da2-a8e9-f3e815e0cd76 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] [instance: 5348eee1-b615-4ef5-a4db-5deec1276724] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:48.404108 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6015b4d3-42b7-4da2-a8e9-f3e815e0cd76 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:48.411524 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6015b4d3-42b7-4da2-a8e9-f3e815e0cd76 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:48.411658 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6015b4d3-42b7-4da2-a8e9-f3e815e0cd76 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:48.412187 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6015b4d3-42b7-4da2-a8e9-f3e815e0cd76 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:48.429352 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.wsgi [None req-6015b4d3-42b7-4da2-a8e9-f3e815e0cd76 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] HTTP exception thrown: Instance 5348eee1-b615-4ef5-a4db-5deec1276724 could not be found. Jul 30 04:59:48.431175 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-6015b4d3-42b7-4da2-a8e9-f3e815e0cd76 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Request method failure captured: Jul 30 04:59:48.431175 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: request: DELETE /compute/v2.1/servers/5348eee1-b615-4ef5-a4db-5deec1276724 HTTP/1.1 Jul 30 04:59:48.431175 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Accept: application/json Jul 30 04:59:48.431175 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Accept-Encoding: identity Jul 30 04:59:48.431175 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Connection: close Jul 30 04:59:48.431175 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Content-Length: 0 Jul 30 04:59:48.431175 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Content-Type: application/json Jul 30 04:59:48.431175 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Host: 10.222.0.20 Jul 30 04:59:48.431175 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Openstack-System-Scope: None Jul 30 04:59:48.431175 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: User-Agent: python-urllib3/1.26.10 Jul 30 04:59:48.431175 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Auth-Token: gAAAAABi5LpuhyHW99TFjplJ7l_QtYlOSzvkQYHSF1nTmA7L4WpI1mR-0XE3ooev0J7TTFGcJWvlk8FQlRKFaXe5lyYudzajYWiSzIERqn8zN3X0y5goNB3wYEsZdJMuGCQLUsEyZLW1mMa3tjp78eS0CZQcOhZH2K3_XGvlkxbmZWM5iCWPHt4 Jul 30 04:59:48.431175 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Domain-Id: None Jul 30 04:59:48.431175 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Domain-Name: None Jul 30 04:59:48.431175 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Identity-Status: Confirmed Jul 30 04:59:48.431175 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Is-Admin-Project: True Jul 30 04:59:48.431175 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Domain-Id: default Jul 30 04:59:48.431175 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Domain-Name: Default Jul 30 04:59:48.431175 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Id: ef5fe5ac675540c0930bd7bab0d8b27f Jul 30 04:59:48.431175 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Name: tempest-DeleteServersTestJSON-1313340388 Jul 30 04:59:48.431175 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Role: member,reader Jul 30 04:59:48.431175 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Roles: member,reader Jul 30 04:59:48.432623 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ef5fe5ac675540c0930bd7bab0d8b27f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ef5fe5ac675540c0930bd7bab0d8b27f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ef5fe5ac675540c0930bd7bab0d8b27f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ef5fe5ac675540c0930bd7bab0d8b27f"}]}] Jul 30 04:59:48.432623 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Tenant: tempest-DeleteServersTestJSON-1313340388 Jul 30 04:59:48.432623 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Tenant-Id: ef5fe5ac675540c0930bd7bab0d8b27f Jul 30 04:59:48.432623 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Tenant-Name: tempest-DeleteServersTestJSON-1313340388 Jul 30 04:59:48.432623 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User: tempest-DeleteServersTestJSON-1313340388-project Jul 30 04:59:48.432623 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Domain-Id: default Jul 30 04:59:48.432623 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Domain-Name: Default Jul 30 04:59:48.432623 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Id: 691a9c5e4d534dcc9c26f8cf88cd7fb5 Jul 30 04:59:48.432623 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Name: tempest-DeleteServersTestJSON-1313340388-project Jul 30 04:59:48.432623 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: method: > Jul 30 04:59:48.432623 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: exception: Instance 5348eee1-b615-4ef5-a4db-5deec1276724 could not be found. Jul 30 04:59:48.432623 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: action_args: {'id': '5348eee1-b615-4ef5-a4db-5deec1276724'} Jul 30 04:59:48.433396 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 04:59:48.433396 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 04:59:48.433396 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 04:59:48.433396 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 04:59:48.433396 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 04:59:48.433396 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 04:59:48.433396 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 04:59:48.433396 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 04:59:48.433396 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 04:59:48.433396 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 04:59:48.433396 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5348eee1-b615-4ef5-a4db-5deec1276724 could not be found. Jul 30 04:59:48.433396 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 04:59:48.433396 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 04:59:48.433396 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 04:59:48.433396 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 04:59:48.433396 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 04:59:48.433396 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 04:59:48.433396 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 04:59:48.433396 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 04:59:48.433396 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 04:59:48.434765 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 04:59:48.434765 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 30 04:59:48.434765 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 30 04:59:48.434765 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 30 04:59:48.434765 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 30 04:59:48.434765 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 04:59:48.434765 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 04:59:48.434765 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 04:59:48.434765 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 04:59:48.434765 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5348eee1-b615-4ef5-a4db-5deec1276724 could not be found. Jul 30 04:59:48.434765 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 04:59:48.434765 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 04:59:48.434765 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 04:59:48.434765 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 04:59:48.434765 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 04:59:48.434765 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 04:59:48.434765 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 04:59:48.434765 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 04:59:48.434765 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5348eee1-b615-4ef5-a4db-5deec1276724 could not be found. Jul 30 04:59:48.434765 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 04:59:48.436932 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-6015b4d3-42b7-4da2-a8e9-f3e815e0cd76 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Returning 404 to user: Instance 5348eee1-b615-4ef5-a4db-5deec1276724 could not be found. {{(pid=117885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 04:59:48.438346 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-6015b4d3-42b7-4da2-a8e9-f3e815e0cd76 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5348eee1-b615-4ef5-a4db-5deec1276724" status: 404 len: 111 microversion: 2.1 time: 0.051049 Jul 30 04:59:48.439406 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 107/228] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Jul 30 04:59:48 2022] DELETE /compute/v2.1/servers/5348eee1-b615-4ef5-a4db-5deec1276724 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 30 04:59:48.448711 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-c37d470a-e18e-439b-ba72-04420f9825d7 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:48.449331 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-c37d470a-e18e-439b-ba72-04420f9825d7 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] [instance: 5348eee1-b615-4ef5-a4db-5deec1276724] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:48.456065 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c37d470a-e18e-439b-ba72-04420f9825d7 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:48.456582 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c37d470a-e18e-439b-ba72-04420f9825d7 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:48.457699 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c37d470a-e18e-439b-ba72-04420f9825d7 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:48.459289 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c37d470a-e18e-439b-ba72-04420f9825d7 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:48.481570 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.wsgi [None req-c37d470a-e18e-439b-ba72-04420f9825d7 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] HTTP exception thrown: Instance 5348eee1-b615-4ef5-a4db-5deec1276724 could not be found. Jul 30 04:59:48.486829 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-c37d470a-e18e-439b-ba72-04420f9825d7 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Request method failure captured: Jul 30 04:59:48.486829 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: request: GET /compute/v2.1/servers/5348eee1-b615-4ef5-a4db-5deec1276724 HTTP/1.1 Jul 30 04:59:48.486829 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Accept: application/json Jul 30 04:59:48.486829 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Accept-Encoding: identity Jul 30 04:59:48.486829 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Connection: close Jul 30 04:59:48.486829 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Content-Length: 0 Jul 30 04:59:48.486829 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Content-Type: application/json Jul 30 04:59:48.486829 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Host: 10.222.0.20 Jul 30 04:59:48.486829 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Openstack-System-Scope: None Jul 30 04:59:48.486829 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: User-Agent: python-urllib3/1.26.10 Jul 30 04:59:48.486829 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Auth-Token: gAAAAABi5LpuhyHW99TFjplJ7l_QtYlOSzvkQYHSF1nTmA7L4WpI1mR-0XE3ooev0J7TTFGcJWvlk8FQlRKFaXe5lyYudzajYWiSzIERqn8zN3X0y5goNB3wYEsZdJMuGCQLUsEyZLW1mMa3tjp78eS0CZQcOhZH2K3_XGvlkxbmZWM5iCWPHt4 Jul 30 04:59:48.486829 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Domain-Id: None Jul 30 04:59:48.486829 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Domain-Name: None Jul 30 04:59:48.486829 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Identity-Status: Confirmed Jul 30 04:59:48.486829 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Is-Admin-Project: True Jul 30 04:59:48.486829 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Project-Domain-Id: default Jul 30 04:59:48.486829 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Project-Domain-Name: Default Jul 30 04:59:48.486829 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Project-Id: ef5fe5ac675540c0930bd7bab0d8b27f Jul 30 04:59:48.486829 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Project-Name: tempest-DeleteServersTestJSON-1313340388 Jul 30 04:59:48.486829 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Role: member,reader Jul 30 04:59:48.486829 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Roles: member,reader Jul 30 04:59:48.489822 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ef5fe5ac675540c0930bd7bab0d8b27f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ef5fe5ac675540c0930bd7bab0d8b27f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ef5fe5ac675540c0930bd7bab0d8b27f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ef5fe5ac675540c0930bd7bab0d8b27f"}]}] Jul 30 04:59:48.489822 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Tenant: tempest-DeleteServersTestJSON-1313340388 Jul 30 04:59:48.489822 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Tenant-Id: ef5fe5ac675540c0930bd7bab0d8b27f Jul 30 04:59:48.489822 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Tenant-Name: tempest-DeleteServersTestJSON-1313340388 Jul 30 04:59:48.489822 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User: tempest-DeleteServersTestJSON-1313340388-project Jul 30 04:59:48.489822 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User-Domain-Id: default Jul 30 04:59:48.489822 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User-Domain-Name: Default Jul 30 04:59:48.489822 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User-Id: 691a9c5e4d534dcc9c26f8cf88cd7fb5 Jul 30 04:59:48.489822 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User-Name: tempest-DeleteServersTestJSON-1313340388-project Jul 30 04:59:48.489822 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: method: > Jul 30 04:59:48.489822 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: exception: Instance 5348eee1-b615-4ef5-a4db-5deec1276724 could not be found. Jul 30 04:59:48.489822 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: action_args: {'id': '5348eee1-b615-4ef5-a4db-5deec1276724'} Jul 30 04:59:48.491243 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 04:59:48.491243 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 04:59:48.491243 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 04:59:48.491243 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 04:59:48.491243 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 04:59:48.491243 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 04:59:48.491243 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 04:59:48.491243 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 04:59:48.491243 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 04:59:48.491243 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 04:59:48.491243 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5348eee1-b615-4ef5-a4db-5deec1276724 could not be found. Jul 30 04:59:48.491243 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 04:59:48.491243 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 04:59:48.491243 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 04:59:48.491243 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 04:59:48.491243 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 04:59:48.491243 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 04:59:48.491243 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 04:59:48.491243 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 04:59:48.491243 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 04:59:48.492918 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 04:59:48.492918 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 04:59:48.492918 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 04:59:48.492918 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 04:59:48.492918 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 04:59:48.492918 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 04:59:48.492918 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 04:59:48.492918 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5348eee1-b615-4ef5-a4db-5deec1276724 could not be found. Jul 30 04:59:48.492918 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 04:59:48.492918 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 04:59:48.492918 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 04:59:48.492918 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 04:59:48.492918 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 04:59:48.492918 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 04:59:48.492918 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 04:59:48.492918 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 04:59:48.492918 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5348eee1-b615-4ef5-a4db-5deec1276724 could not be found. Jul 30 04:59:48.492918 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 04:59:48.494033 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-c37d470a-e18e-439b-ba72-04420f9825d7 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] Returning 404 to user: Instance 5348eee1-b615-4ef5-a4db-5deec1276724 could not be found. {{(pid=117886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 04:59:48.494033 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-c37d470a-e18e-439b-ba72-04420f9825d7 tempest-DeleteServersTestJSON-1313340388 tempest-DeleteServersTestJSON-1313340388-project] 10.222.0.20 "GET /compute/v2.1/servers/5348eee1-b615-4ef5-a4db-5deec1276724" status: 404 len: 111 microversion: 2.1 time: 0.045159 Jul 30 04:59:48.494033 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 122/229] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:59:48 2022] GET /compute/v2.1/servers/5348eee1-b615-4ef5-a4db-5deec1276724 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 04:59:48.951237 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-22fe5b02-45e2-45bc-bd3b-f7fc95c58bbd tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:48.952635 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-22fe5b02-45e2-45bc-bd3b-f7fc95c58bbd tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 7b5e218d-8660-4d90-90d1-9c8e50a66a7c] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:48.962186 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-22fe5b02-45e2-45bc-bd3b-f7fc95c58bbd tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:48.962677 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-22fe5b02-45e2-45bc-bd3b-f7fc95c58bbd tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:48.963628 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-22fe5b02-45e2-45bc-bd3b-f7fc95c58bbd tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:48.964209 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-22fe5b02-45e2-45bc-bd3b-f7fc95c58bbd tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:49.215376 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-22fe5b02-45e2-45bc-bd3b-f7fc95c58bbd tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:49.224925 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-22fe5b02-45e2-45bc-bd3b-f7fc95c58bbd tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c" status: 200 len: 1522 microversion: 2.1 time: 0.279046 Jul 30 04:59:49.225771 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 108/230] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:59:48 2022] GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c => generated 1522 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:59:50.248570 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-f9c2890e-987d-4347-9ae4-e40fde8b022b tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:50.249208 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-f9c2890e-987d-4347-9ae4-e40fde8b022b tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 7b5e218d-8660-4d90-90d1-9c8e50a66a7c] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:50.256735 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f9c2890e-987d-4347-9ae4-e40fde8b022b tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:50.260215 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f9c2890e-987d-4347-9ae4-e40fde8b022b tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:50.261583 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f9c2890e-987d-4347-9ae4-e40fde8b022b tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:50.264141 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f9c2890e-987d-4347-9ae4-e40fde8b022b tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:50.705240 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-f9c2890e-987d-4347-9ae4-e40fde8b022b tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:50.718053 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-f9c2890e-987d-4347-9ae4-e40fde8b022b tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c" status: 200 len: 1522 microversion: 2.1 time: 0.473263 Jul 30 04:59:50.719413 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 123/231] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:59:50 2022] GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c => generated 1522 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:59:51.764403 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-81514369-ee15-47b9-9db7-184b865efa9c tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:51.771217 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-81514369-ee15-47b9-9db7-184b865efa9c tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 7b5e218d-8660-4d90-90d1-9c8e50a66a7c] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:51.782192 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-81514369-ee15-47b9-9db7-184b865efa9c tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:51.782742 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-81514369-ee15-47b9-9db7-184b865efa9c tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:51.783538 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-81514369-ee15-47b9-9db7-184b865efa9c tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:51.784051 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-81514369-ee15-47b9-9db7-184b865efa9c tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:52.074918 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-81514369-ee15-47b9-9db7-184b865efa9c tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:52.088080 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-81514369-ee15-47b9-9db7-184b865efa9c tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c" status: 200 len: 1522 microversion: 2.1 time: 0.327325 Jul 30 04:59:52.088703 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 109/232] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:59:51 2022] GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c => generated 1522 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 04:59:53.133258 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-bb4dbcdc-edbd-48d1-8a60-008b98915a80 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:53.133880 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-bb4dbcdc-edbd-48d1-8a60-008b98915a80 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 7b5e218d-8660-4d90-90d1-9c8e50a66a7c] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:53.153201 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bb4dbcdc-edbd-48d1-8a60-008b98915a80 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:53.153667 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bb4dbcdc-edbd-48d1-8a60-008b98915a80 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:53.154718 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bb4dbcdc-edbd-48d1-8a60-008b98915a80 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:53.155351 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bb4dbcdc-edbd-48d1-8a60-008b98915a80 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:53.366386 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-bb4dbcdc-edbd-48d1-8a60-008b98915a80 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:53.377257 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-bb4dbcdc-edbd-48d1-8a60-008b98915a80 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c" status: 200 len: 1522 microversion: 2.1 time: 0.271535 Jul 30 04:59:53.378723 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 124/233] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:59:53 2022] GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c => generated 1522 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:59:54.401144 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-fc0bb011-9b84-4411-8e21-4ed0a69b5723 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:54.402666 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-fc0bb011-9b84-4411-8e21-4ed0a69b5723 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 7b5e218d-8660-4d90-90d1-9c8e50a66a7c] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:54.409822 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-fc0bb011-9b84-4411-8e21-4ed0a69b5723 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:54.410667 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-fc0bb011-9b84-4411-8e21-4ed0a69b5723 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:54.411693 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-fc0bb011-9b84-4411-8e21-4ed0a69b5723 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:54.412474 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-fc0bb011-9b84-4411-8e21-4ed0a69b5723 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:54.457999 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-73ddbd30-3a02-41c0-aacb-52b6b63d6eb0 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-2039542055", "imageRef": "d6a9c8e1-ecb9-4603-bb88-2b0d46ac2387", "flavorRef": "452"}} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 04:59:54.526312 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.network.neutron [None req-73ddbd30-3a02-41c0-aacb-52b6b63d6eb0 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] validate_networks() for None {{(pid=117886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 04:59:54.607705 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-fc0bb011-9b84-4411-8e21-4ed0a69b5723 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:54.618705 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-fc0bb011-9b84-4411-8e21-4ed0a69b5723 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c" status: 200 len: 1522 microversion: 2.1 time: 0.221119 Jul 30 04:59:54.622567 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 110/234] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:59:54 2022] GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c => generated 1522 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:59:54.903529 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-73ddbd30-3a02-41c0-aacb-52b6b63d6eb0 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] Flavor limits 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 04:59:54.904064 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-73ddbd30-3a02-41c0-aacb-52b6b63d6eb0 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] Image limits 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 04:59:54.904637 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-73ddbd30-3a02-41c0-aacb-52b6b63d6eb0 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] Flavor pref 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 04:59:54.905049 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-73ddbd30-3a02-41c0-aacb-52b6b63d6eb0 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] Image pref 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 04:59:54.905745 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-73ddbd30-3a02-41c0-aacb-52b6b63d6eb0 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 04:59:54.915684 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-73ddbd30-3a02-41c0-aacb-52b6b63d6eb0 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:54.916128 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-73ddbd30-3a02-41c0-aacb-52b6b63d6eb0 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:54.916909 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-73ddbd30-3a02-41c0-aacb-52b6b63d6eb0 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:54.917601 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-73ddbd30-3a02-41c0-aacb-52b6b63d6eb0 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:54.945136 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.quota [None req-73ddbd30-3a02-41c0-aacb-52b6b63d6eb0 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] Getting quotas for project 5dc01f77fe9745369cef62c8379f9209. Resources: {'ram', 'cores', 'instances'} {{(pid=117886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 04:59:54.950157 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.quota [None req-73ddbd30-3a02-41c0-aacb-52b6b63d6eb0 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] Getting quotas for user 929d7587f49445ed9c86d53a1d888648 and project 5dc01f77fe9745369cef62c8379f9209. Resources: {'ram', 'cores', 'instances'} {{(pid=117886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 04:59:54.975142 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-73ddbd30-3a02-41c0-aacb-52b6b63d6eb0 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] Going to run 1 instances... {{(pid=117886) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 04:59:54.977404 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-73ddbd30-3a02-41c0-aacb-52b6b63d6eb0 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] [instance: 1b4b194e-e03a-474d-8f65-701f6622fdb0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d6a9c8e1-ecb9-4603-bb88-2b0d46ac2387',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 04:59:55.088792 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-73ddbd30-3a02-41c0-aacb-52b6b63d6eb0 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.636439 Jul 30 04:59:55.100376 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 125/235] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Jul 30 04:59:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 649 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 04:59:55.100743 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-8aeaf81e-e740-4354-9052-10981834ce40 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:55.101501 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-8aeaf81e-e740-4354-9052-10981834ce40 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] [instance: 1b4b194e-e03a-474d-8f65-701f6622fdb0] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:55.215912 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-8aeaf81e-e740-4354-9052-10981834ce40 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929d7587f49445ed9c86d53a1d888648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc01f77fe9745369cef62c8379f9209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:55.224982 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-8aeaf81e-e740-4354-9052-10981834ce40 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] 10.222.0.20 "GET /compute/v2.1/servers/1b4b194e-e03a-474d-8f65-701f6622fdb0" status: 200 len: 1215 microversion: 2.1 time: 0.128551 Jul 30 04:59:55.227653 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 111/236] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:59:55 2022] GET /compute/v2.1/servers/1b4b194e-e03a-474d-8f65-701f6622fdb0 => generated 1215 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:59:55.459251 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-16be0cea-b599-4be5-9545-7737eae2fb73 tempest-VolumesNegativeTest-703696501 tempest-VolumesNegativeTest-703696501-project] Action: 'create', calling method: .version_select at 0x7f2db41f1ee0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-119482757", "metadata": {"Type": "work"}}} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 04:59:55.470915 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-16be0cea-b599-4be5-9545-7737eae2fb73 tempest-VolumesNegativeTest-703696501 tempest-VolumesNegativeTest-703696501-project] Request method failure captured: Jul 30 04:59:55.470915 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 30 04:59:55.470915 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Accept: application/json Jul 30 04:59:55.470915 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Accept-Encoding: identity Jul 30 04:59:55.470915 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Connection: close Jul 30 04:59:55.470915 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Content-Length: 121 Jul 30 04:59:55.470915 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Content-Type: application/json Jul 30 04:59:55.470915 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Host: 10.222.0.20 Jul 30 04:59:55.470915 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Openstack-System-Scope: None Jul 30 04:59:55.470915 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: User-Agent: python-urllib3/1.26.10 Jul 30 04:59:55.470915 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Auth-Token: gAAAAABi5LrLsVClOUJOSkpxhSF-P1ntfRirb27WlAplgTG0ZC7q-Rc9zHkqA2rXOnb_uxL5qxunTwFKGoK_NrqSBS5n_W2w7x37Kv2dKQTxBc_LIxgNxLKGq2gJIbMeSZIU_nUMeSnbwOt2Oe6U_zZkUDWneiPjcj-R7k0jGUYVm69Pp30ttg4 Jul 30 04:59:55.470915 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Domain-Id: None Jul 30 04:59:55.470915 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Domain-Name: None Jul 30 04:59:55.470915 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Identity-Status: Confirmed Jul 30 04:59:55.470915 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Is-Admin-Project: True Jul 30 04:59:55.470915 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Project-Domain-Id: default Jul 30 04:59:55.470915 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Project-Domain-Name: Default Jul 30 04:59:55.470915 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Project-Id: c99e869e8f634c5b86d9939d3d168657 Jul 30 04:59:55.470915 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Project-Name: tempest-VolumesNegativeTest-703696501 Jul 30 04:59:55.470915 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Role: member,reader Jul 30 04:59:55.470915 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Roles: member,reader Jul 30 04:59:55.472773 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c99e869e8f634c5b86d9939d3d168657"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c99e869e8f634c5b86d9939d3d168657"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c99e869e8f634c5b86d9939d3d168657"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c99e869e8f634c5b86d9939d3d168657"}]}] Jul 30 04:59:55.472773 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Tenant: tempest-VolumesNegativeTest-703696501 Jul 30 04:59:55.472773 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Tenant-Id: c99e869e8f634c5b86d9939d3d168657 Jul 30 04:59:55.472773 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Tenant-Name: tempest-VolumesNegativeTest-703696501 Jul 30 04:59:55.472773 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User: tempest-VolumesNegativeTest-703696501-project Jul 30 04:59:55.472773 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User-Domain-Id: default Jul 30 04:59:55.472773 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User-Domain-Name: Default Jul 30 04:59:55.472773 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User-Id: 4412c814ea3d4ed39281696df34ededa Jul 30 04:59:55.472773 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User-Name: tempest-VolumesNegativeTest-703696501-project Jul 30 04:59:55.472773 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Jul 30 04:59:55.472773 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-119482757", "metadata": {"Type": "work"}}} Jul 30 04:59:55.472773 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: method: Jul 30 04:59:55.472773 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 30 04:59:55.473590 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-119482757', 'metadata': {'Type': 'work'}}}} Jul 30 04:59:55.473590 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 04:59:55.473590 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 04:59:55.473590 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 30 04:59:55.473590 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 30 04:59:55.473590 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 30 04:59:55.473590 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise error Jul 30 04:59:55.473590 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 30 04:59:55.473590 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 04:59:55.473590 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 30 04:59:55.473590 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 30 04:59:55.473590 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 04:59:55.473590 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 30 04:59:55.473590 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi '#$%' Jul 30 04:59:55.473590 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 04:59:55.473590 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 04:59:55.473590 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 04:59:55.473590 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 04:59:55.473590 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 04:59:55.473590 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 04:59:55.473590 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 04:59:55.473590 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 04:59:55.475619 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 04:59:55.475619 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 04:59:55.475619 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 04:59:55.475619 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 04:59:55.475619 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 30 04:59:55.475619 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 30 04:59:55.475619 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 30 04:59:55.475619 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 30 04:59:55.475619 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 30 04:59:55.475619 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 30 04:59:55.475619 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 30 04:59:55.475619 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 04:59:55.475619 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 04:59:55.475619 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 04:59:55.475619 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 04:59:55.475619 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 04:59:55.475619 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 04:59:55.475619 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 30 04:59:55.475619 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 30 04:59:55.476644 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 30 04:59:55.476644 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 04:59:55.476644 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-16be0cea-b599-4be5-9545-7737eae2fb73 tempest-VolumesNegativeTest-703696501 tempest-VolumesNegativeTest-703696501-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 04:59:55.476644 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-16be0cea-b599-4be5-9545-7737eae2fb73 tempest-VolumesNegativeTest-703696501 tempest-VolumesNegativeTest-703696501-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.171015 Jul 30 04:59:55.476644 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 126/237] 10.222.0.20 () {60 vars in 1156 bytes} [Sat Jul 30 04:59:55 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 172 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 30 04:59:55.485640 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-513c882d-0765-48aa-a418-559be9e8f182 tempest-VolumesNegativeTest-703696501 tempest-VolumesNegativeTest-703696501-project] Action: 'create', calling method: .version_select at 0x7f2db42e8c10>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1488193588", "metadata": {"Type": "work"}}} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 04:59:55.492185 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-513c882d-0765-48aa-a418-559be9e8f182 tempest-VolumesNegativeTest-703696501 tempest-VolumesNegativeTest-703696501-project] Request method failure captured: Jul 30 04:59:55.492185 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 30 04:59:55.492185 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Accept: application/json Jul 30 04:59:55.492185 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Accept-Encoding: identity Jul 30 04:59:55.492185 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Connection: close Jul 30 04:59:55.492185 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Content-Length: 120 Jul 30 04:59:55.492185 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Content-Type: application/json Jul 30 04:59:55.492185 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Host: 10.222.0.20 Jul 30 04:59:55.492185 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Openstack-System-Scope: None Jul 30 04:59:55.492185 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: User-Agent: python-urllib3/1.26.10 Jul 30 04:59:55.492185 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Auth-Token: gAAAAABi5LrLsVClOUJOSkpxhSF-P1ntfRirb27WlAplgTG0ZC7q-Rc9zHkqA2rXOnb_uxL5qxunTwFKGoK_NrqSBS5n_W2w7x37Kv2dKQTxBc_LIxgNxLKGq2gJIbMeSZIU_nUMeSnbwOt2Oe6U_zZkUDWneiPjcj-R7k0jGUYVm69Pp30ttg4 Jul 30 04:59:55.492185 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Domain-Id: None Jul 30 04:59:55.492185 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Domain-Name: None Jul 30 04:59:55.492185 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Identity-Status: Confirmed Jul 30 04:59:55.492185 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Is-Admin-Project: True Jul 30 04:59:55.492185 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Domain-Id: default Jul 30 04:59:55.492185 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Domain-Name: Default Jul 30 04:59:55.492185 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Id: c99e869e8f634c5b86d9939d3d168657 Jul 30 04:59:55.492185 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Name: tempest-VolumesNegativeTest-703696501 Jul 30 04:59:55.492185 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Role: member,reader Jul 30 04:59:55.492185 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Roles: member,reader Jul 30 04:59:55.493640 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c99e869e8f634c5b86d9939d3d168657"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c99e869e8f634c5b86d9939d3d168657"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c99e869e8f634c5b86d9939d3d168657"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c99e869e8f634c5b86d9939d3d168657"}]}] Jul 30 04:59:55.493640 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Tenant: tempest-VolumesNegativeTest-703696501 Jul 30 04:59:55.493640 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Tenant-Id: c99e869e8f634c5b86d9939d3d168657 Jul 30 04:59:55.493640 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Tenant-Name: tempest-VolumesNegativeTest-703696501 Jul 30 04:59:55.493640 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User: tempest-VolumesNegativeTest-703696501-project Jul 30 04:59:55.493640 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Domain-Id: default Jul 30 04:59:55.493640 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Domain-Name: Default Jul 30 04:59:55.493640 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Id: 4412c814ea3d4ed39281696df34ededa Jul 30 04:59:55.493640 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Name: tempest-VolumesNegativeTest-703696501-project Jul 30 04:59:55.493640 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Jul 30 04:59:55.493640 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1488193588", "metadata": {"Type": "work"}}} Jul 30 04:59:55.493640 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: method: Jul 30 04:59:55.493640 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 30 04:59:55.494705 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1488193588', 'metadata': {'Type': 'work'}}}} Jul 30 04:59:55.494705 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 04:59:55.494705 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 04:59:55.494705 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 30 04:59:55.494705 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 30 04:59:55.494705 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 30 04:59:55.494705 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise error Jul 30 04:59:55.494705 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 30 04:59:55.494705 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 04:59:55.494705 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 30 04:59:55.494705 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 30 04:59:55.494705 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 04:59:55.494705 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 30 04:59:55.494705 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi '0' Jul 30 04:59:55.494705 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 04:59:55.494705 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 04:59:55.494705 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 04:59:55.494705 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 04:59:55.494705 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 04:59:55.494705 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 04:59:55.494705 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 04:59:55.494705 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 04:59:55.496830 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 04:59:55.496830 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 04:59:55.496830 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 04:59:55.496830 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 04:59:55.496830 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 30 04:59:55.496830 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 30 04:59:55.496830 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 30 04:59:55.496830 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 30 04:59:55.496830 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 30 04:59:55.496830 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 30 04:59:55.496830 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 30 04:59:55.496830 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 04:59:55.496830 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 04:59:55.496830 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 04:59:55.496830 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 04:59:55.496830 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 04:59:55.496830 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 04:59:55.496830 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 30 04:59:55.496830 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 30 04:59:55.497818 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 30 04:59:55.497818 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 04:59:55.497818 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-513c882d-0765-48aa-a418-559be9e8f182 tempest-VolumesNegativeTest-703696501 tempest-VolumesNegativeTest-703696501-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 04:59:55.497818 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-513c882d-0765-48aa-a418-559be9e8f182 tempest-VolumesNegativeTest-703696501 tempest-VolumesNegativeTest-703696501-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.012830 Jul 30 04:59:55.497818 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 112/238] 10.222.0.20 () {60 vars in 1156 bytes} [Sat Jul 30 04:59:55 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 30 04:59:55.504923 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-c44fe95b-e011-4c9f-8f24-ed6e830ab004 tempest-VolumesNegativeTest-703696501 tempest-VolumesNegativeTest-703696501-project] Action: 'create', calling method: .version_select at 0x7f2db4214940>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1709320809", "metadata": {"Type": "work"}}} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 04:59:55.510799 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-c44fe95b-e011-4c9f-8f24-ed6e830ab004 tempest-VolumesNegativeTest-703696501 tempest-VolumesNegativeTest-703696501-project] Request method failure captured: Jul 30 04:59:55.510799 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 30 04:59:55.510799 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Accept: application/json Jul 30 04:59:55.510799 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Accept-Encoding: identity Jul 30 04:59:55.510799 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Connection: close Jul 30 04:59:55.510799 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Content-Length: 119 Jul 30 04:59:55.510799 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Content-Type: application/json Jul 30 04:59:55.510799 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Host: 10.222.0.20 Jul 30 04:59:55.510799 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Openstack-System-Scope: None Jul 30 04:59:55.510799 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: User-Agent: python-urllib3/1.26.10 Jul 30 04:59:55.510799 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Auth-Token: gAAAAABi5LrLsVClOUJOSkpxhSF-P1ntfRirb27WlAplgTG0ZC7q-Rc9zHkqA2rXOnb_uxL5qxunTwFKGoK_NrqSBS5n_W2w7x37Kv2dKQTxBc_LIxgNxLKGq2gJIbMeSZIU_nUMeSnbwOt2Oe6U_zZkUDWneiPjcj-R7k0jGUYVm69Pp30ttg4 Jul 30 04:59:55.510799 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Domain-Id: None Jul 30 04:59:55.510799 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Domain-Name: None Jul 30 04:59:55.510799 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Identity-Status: Confirmed Jul 30 04:59:55.510799 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Is-Admin-Project: True Jul 30 04:59:55.510799 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Project-Domain-Id: default Jul 30 04:59:55.510799 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Project-Domain-Name: Default Jul 30 04:59:55.510799 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Project-Id: c99e869e8f634c5b86d9939d3d168657 Jul 30 04:59:55.510799 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Project-Name: tempest-VolumesNegativeTest-703696501 Jul 30 04:59:55.510799 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Role: member,reader Jul 30 04:59:55.510799 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Roles: member,reader Jul 30 04:59:55.512076 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c99e869e8f634c5b86d9939d3d168657"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c99e869e8f634c5b86d9939d3d168657"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c99e869e8f634c5b86d9939d3d168657"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c99e869e8f634c5b86d9939d3d168657"}]}] Jul 30 04:59:55.512076 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Tenant: tempest-VolumesNegativeTest-703696501 Jul 30 04:59:55.512076 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Tenant-Id: c99e869e8f634c5b86d9939d3d168657 Jul 30 04:59:55.512076 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Tenant-Name: tempest-VolumesNegativeTest-703696501 Jul 30 04:59:55.512076 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User: tempest-VolumesNegativeTest-703696501-project Jul 30 04:59:55.512076 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User-Domain-Id: default Jul 30 04:59:55.512076 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User-Domain-Name: Default Jul 30 04:59:55.512076 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User-Id: 4412c814ea3d4ed39281696df34ededa Jul 30 04:59:55.512076 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User-Name: tempest-VolumesNegativeTest-703696501-project Jul 30 04:59:55.512076 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Jul 30 04:59:55.512076 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1709320809", "metadata": {"Type": "work"}}} Jul 30 04:59:55.512076 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: method: Jul 30 04:59:55.512076 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 30 04:59:55.512782 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1709320809', 'metadata': {'Type': 'work'}}}} Jul 30 04:59:55.512782 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 04:59:55.512782 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 04:59:55.512782 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 30 04:59:55.512782 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 30 04:59:55.512782 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 30 04:59:55.512782 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise error Jul 30 04:59:55.512782 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 30 04:59:55.512782 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 04:59:55.512782 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 30 04:59:55.512782 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 30 04:59:55.512782 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 04:59:55.512782 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 30 04:59:55.512782 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi '' Jul 30 04:59:55.512782 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 04:59:55.512782 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 04:59:55.512782 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 04:59:55.512782 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 04:59:55.512782 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 04:59:55.512782 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 04:59:55.512782 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 04:59:55.512782 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 04:59:55.513956 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 04:59:55.513956 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 04:59:55.513956 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 04:59:55.513956 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 04:59:55.513956 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 30 04:59:55.513956 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 30 04:59:55.513956 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 30 04:59:55.513956 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 30 04:59:55.513956 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 30 04:59:55.513956 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 30 04:59:55.513956 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 30 04:59:55.513956 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 04:59:55.513956 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 04:59:55.513956 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 04:59:55.513956 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 04:59:55.513956 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 04:59:55.513956 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 04:59:55.513956 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 30 04:59:55.513956 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 30 04:59:55.516626 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 30 04:59:55.516626 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 04:59:55.516626 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-c44fe95b-e011-4c9f-8f24-ed6e830ab004 tempest-VolumesNegativeTest-703696501 tempest-VolumesNegativeTest-703696501-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 04:59:55.516626 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-c44fe95b-e011-4c9f-8f24-ed6e830ab004 tempest-VolumesNegativeTest-703696501 tempest-VolumesNegativeTest-703696501-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.012434 Jul 30 04:59:55.516626 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 127/239] 10.222.0.20 () {60 vars in 1156 bytes} [Sat Jul 30 04:59:55 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 30 04:59:55.527359 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-c3b3d94c-14c4-4954-ab6c-2bb4bb8b737e tempest-VolumesNegativeTest-703696501 tempest-VolumesNegativeTest-703696501-project] Calling method '.version_select at 0x7f2db44855e0>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:55.563980 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.wsgi [None req-c3b3d94c-14c4-4954-ab6c-2bb4bb8b737e tempest-VolumesNegativeTest-703696501 tempest-VolumesNegativeTest-703696501-project] HTTP exception thrown: Volume tempest-invalid-988531269 could not be found. Jul 30 04:59:55.567279 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-c3b3d94c-14c4-4954-ab6c-2bb4bb8b737e tempest-VolumesNegativeTest-703696501 tempest-VolumesNegativeTest-703696501-project] Request method failure captured: Jul 30 04:59:55.567279 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-988531269 HTTP/1.1 Jul 30 04:59:55.567279 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Accept: application/json Jul 30 04:59:55.567279 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Accept-Encoding: identity Jul 30 04:59:55.567279 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Connection: close Jul 30 04:59:55.567279 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Content-Length: 0 Jul 30 04:59:55.567279 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Content-Type: application/json Jul 30 04:59:55.567279 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Host: 10.222.0.20 Jul 30 04:59:55.567279 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Openstack-System-Scope: None Jul 30 04:59:55.567279 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: User-Agent: python-urllib3/1.26.10 Jul 30 04:59:55.567279 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Auth-Token: gAAAAABi5LrLsVClOUJOSkpxhSF-P1ntfRirb27WlAplgTG0ZC7q-Rc9zHkqA2rXOnb_uxL5qxunTwFKGoK_NrqSBS5n_W2w7x37Kv2dKQTxBc_LIxgNxLKGq2gJIbMeSZIU_nUMeSnbwOt2Oe6U_zZkUDWneiPjcj-R7k0jGUYVm69Pp30ttg4 Jul 30 04:59:55.567279 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Domain-Id: None Jul 30 04:59:55.567279 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Domain-Name: None Jul 30 04:59:55.567279 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Identity-Status: Confirmed Jul 30 04:59:55.567279 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Is-Admin-Project: True Jul 30 04:59:55.567279 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Domain-Id: default Jul 30 04:59:55.567279 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Domain-Name: Default Jul 30 04:59:55.567279 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Id: c99e869e8f634c5b86d9939d3d168657 Jul 30 04:59:55.567279 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Name: tempest-VolumesNegativeTest-703696501 Jul 30 04:59:55.567279 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Role: member,reader Jul 30 04:59:55.567279 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Roles: member,reader Jul 30 04:59:55.568768 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c99e869e8f634c5b86d9939d3d168657"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c99e869e8f634c5b86d9939d3d168657"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c99e869e8f634c5b86d9939d3d168657"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c99e869e8f634c5b86d9939d3d168657"}]}] Jul 30 04:59:55.568768 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Tenant: tempest-VolumesNegativeTest-703696501 Jul 30 04:59:55.568768 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Tenant-Id: c99e869e8f634c5b86d9939d3d168657 Jul 30 04:59:55.568768 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Tenant-Name: tempest-VolumesNegativeTest-703696501 Jul 30 04:59:55.568768 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User: tempest-VolumesNegativeTest-703696501-project Jul 30 04:59:55.568768 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Domain-Id: default Jul 30 04:59:55.568768 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Domain-Name: Default Jul 30 04:59:55.568768 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Id: 4412c814ea3d4ed39281696df34ededa Jul 30 04:59:55.568768 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Name: tempest-VolumesNegativeTest-703696501-project Jul 30 04:59:55.568768 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: method: Jul 30 04:59:55.568768 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: exception: Volume tempest-invalid-988531269 could not be found. Jul 30 04:59:55.568768 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: action_args: {'id': 'tempest-invalid-988531269'} Jul 30 04:59:55.568768 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 04:59:55.569660 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 04:59:55.569660 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 30 04:59:55.569660 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 30 04:59:55.569660 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 30 04:59:55.569660 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 30 04:59:55.569660 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 30 04:59:55.569660 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 30 04:59:55.569660 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 30 04:59:55.569660 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 30 04:59:55.569660 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 30 04:59:55.569660 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 30 04:59:55.569660 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 30 04:59:55.569660 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 30 04:59:55.569660 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 30 04:59:55.569660 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 30 04:59:55.569660 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-988531269 could not be found. (HTTP 404) (Request-ID: req-4fa3cdb3-e9fe-4b55-adf6-7b6a0412ab47) Jul 30 04:59:55.569660 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 04:59:55.569660 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 04:59:55.569660 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 04:59:55.570974 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 04:59:55.570974 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 30 04:59:55.570974 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 30 04:59:55.570974 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 30 04:59:55.570974 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 30 04:59:55.570974 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 30 04:59:55.570974 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 30 04:59:55.570974 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 30 04:59:55.570974 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 30 04:59:55.570974 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 30 04:59:55.570974 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 30 04:59:55.570974 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 30 04:59:55.570974 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 30 04:59:55.570974 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 30 04:59:55.570974 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 30 04:59:55.570974 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 30 04:59:55.570974 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 30 04:59:55.570974 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 30 04:59:55.570974 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 30 04:59:55.572102 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 30 04:59:55.572102 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 30 04:59:55.572102 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 30 04:59:55.572102 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 30 04:59:55.572102 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-988531269 could not be found. Jul 30 04:59:55.572102 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 04:59:55.572102 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 04:59:55.572102 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 04:59:55.572102 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 04:59:55.572102 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 04:59:55.572102 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 04:59:55.572102 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 04:59:55.572102 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 04:59:55.572102 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 04:59:55.572102 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 04:59:55.572102 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 04:59:55.572102 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 04:59:55.572102 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 30 04:59:55.572102 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 04:59:55.572102 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-988531269 could not be found. Jul 30 04:59:55.573405 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 04:59:55.573405 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 04:59:55.573405 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 04:59:55.573405 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 04:59:55.573405 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 04:59:55.573405 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 04:59:55.573405 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 04:59:55.573405 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 04:59:55.573405 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-988531269 could not be found. Jul 30 04:59:55.573405 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 04:59:55.573405 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-c3b3d94c-14c4-4954-ab6c-2bb4bb8b737e tempest-VolumesNegativeTest-703696501 tempest-VolumesNegativeTest-703696501-project] Returning 404 to user: Volume tempest-invalid-988531269 could not be found. {{(pid=117885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 04:59:55.573405 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-c3b3d94c-14c4-4954-ab6c-2bb4bb8b737e tempest-VolumesNegativeTest-703696501 tempest-VolumesNegativeTest-703696501-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/tempest-invalid-988531269" status: 404 len: 98 microversion: 2.1 time: 0.049544 Jul 30 04:59:55.573405 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 113/240] 10.222.0.20 () {58 vars in 1215 bytes} [Sat Jul 30 04:59:55 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-988531269 => generated 98 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 30 04:59:55.582454 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-dd693dd4-c0e6-44fd-b6ff-55838b004d1f tempest-VolumesNegativeTest-703696501 tempest-VolumesNegativeTest-703696501-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004519 Jul 30 04:59:55.583187 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 128/241] 10.222.0.20 () {58 vars in 1140 bytes} [Sat Jul 30 04:59:55 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 30 04:59:55.593069 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-f260f931-2fdb-47db-b2d5-a75274d0e04b tempest-VolumesNegativeTest-703696501 tempest-VolumesNegativeTest-703696501-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004813 Jul 30 04:59:55.593567 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 114/242] 10.222.0.20 () {58 vars in 1137 bytes} [Sat Jul 30 04:59:55 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 30 04:59:55.603710 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-01755202-c011-4935-af20-addae73f879d tempest-VolumesNegativeTest-703696501 tempest-VolumesNegativeTest-703696501-project] Calling method '.version_select at 0x7f2db43dd550>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:55.642693 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-ebdcb355-2472-41c4-bc71-ec39e47052c5 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:55.643584 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-ebdcb355-2472-41c4-bc71-ec39e47052c5 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 7b5e218d-8660-4d90-90d1-9c8e50a66a7c] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:55.650949 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.wsgi [None req-01755202-c011-4935-af20-addae73f879d tempest-VolumesNegativeTest-703696501 tempest-VolumesNegativeTest-703696501-project] HTTP exception thrown: Volume 6fd7ebda-bc69-483c-879a-526a1a08323e could not be found. Jul 30 04:59:55.651638 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ebdcb355-2472-41c4-bc71-ec39e47052c5 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:55.652388 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ebdcb355-2472-41c4-bc71-ec39e47052c5 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:55.653382 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ebdcb355-2472-41c4-bc71-ec39e47052c5 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:55.653976 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ebdcb355-2472-41c4-bc71-ec39e47052c5 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:55.655351 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-01755202-c011-4935-af20-addae73f879d tempest-VolumesNegativeTest-703696501 tempest-VolumesNegativeTest-703696501-project] Request method failure captured: Jul 30 04:59:55.655351 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: request: DELETE /compute/v2.1/os-volumes/6fd7ebda-bc69-483c-879a-526a1a08323e HTTP/1.1 Jul 30 04:59:55.655351 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Accept: application/json Jul 30 04:59:55.655351 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Accept-Encoding: identity Jul 30 04:59:55.655351 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Connection: close Jul 30 04:59:55.655351 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Content-Length: 0 Jul 30 04:59:55.655351 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Content-Type: application/json Jul 30 04:59:55.655351 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Host: 10.222.0.20 Jul 30 04:59:55.655351 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Openstack-System-Scope: None Jul 30 04:59:55.655351 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: User-Agent: python-urllib3/1.26.10 Jul 30 04:59:55.655351 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Auth-Token: gAAAAABi5LrLsVClOUJOSkpxhSF-P1ntfRirb27WlAplgTG0ZC7q-Rc9zHkqA2rXOnb_uxL5qxunTwFKGoK_NrqSBS5n_W2w7x37Kv2dKQTxBc_LIxgNxLKGq2gJIbMeSZIU_nUMeSnbwOt2Oe6U_zZkUDWneiPjcj-R7k0jGUYVm69Pp30ttg4 Jul 30 04:59:55.655351 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Domain-Id: None Jul 30 04:59:55.655351 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Domain-Name: None Jul 30 04:59:55.655351 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Identity-Status: Confirmed Jul 30 04:59:55.655351 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Is-Admin-Project: True Jul 30 04:59:55.655351 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Project-Domain-Id: default Jul 30 04:59:55.655351 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Project-Domain-Name: Default Jul 30 04:59:55.655351 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Project-Id: c99e869e8f634c5b86d9939d3d168657 Jul 30 04:59:55.655351 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Project-Name: tempest-VolumesNegativeTest-703696501 Jul 30 04:59:55.655351 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Role: member,reader Jul 30 04:59:55.655351 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Roles: member,reader Jul 30 04:59:55.656530 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c99e869e8f634c5b86d9939d3d168657"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c99e869e8f634c5b86d9939d3d168657"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c99e869e8f634c5b86d9939d3d168657"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c99e869e8f634c5b86d9939d3d168657"}]}] Jul 30 04:59:55.656530 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Tenant: tempest-VolumesNegativeTest-703696501 Jul 30 04:59:55.656530 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Tenant-Id: c99e869e8f634c5b86d9939d3d168657 Jul 30 04:59:55.656530 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Tenant-Name: tempest-VolumesNegativeTest-703696501 Jul 30 04:59:55.656530 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User: tempest-VolumesNegativeTest-703696501-project Jul 30 04:59:55.656530 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User-Domain-Id: default Jul 30 04:59:55.656530 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User-Domain-Name: Default Jul 30 04:59:55.656530 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User-Id: 4412c814ea3d4ed39281696df34ededa Jul 30 04:59:55.656530 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User-Name: tempest-VolumesNegativeTest-703696501-project Jul 30 04:59:55.656530 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: method: Jul 30 04:59:55.656530 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: exception: Volume 6fd7ebda-bc69-483c-879a-526a1a08323e could not be found. Jul 30 04:59:55.656530 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: action_args: {'id': '6fd7ebda-bc69-483c-879a-526a1a08323e'} Jul 30 04:59:55.656530 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 04:59:55.657261 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 04:59:55.657261 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 30 04:59:55.657261 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 30 04:59:55.657261 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 30 04:59:55.657261 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 30 04:59:55.657261 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 30 04:59:55.657261 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 30 04:59:55.657261 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 30 04:59:55.657261 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 30 04:59:55.657261 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 30 04:59:55.657261 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 30 04:59:55.657261 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 30 04:59:55.657261 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 30 04:59:55.657261 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 30 04:59:55.657261 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 30 04:59:55.657261 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6fd7ebda-bc69-483c-879a-526a1a08323e could not be found. (HTTP 404) (Request-ID: req-7626fda8-27ab-4dc3-83fb-6b28f0a16af0) Jul 30 04:59:55.657261 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 04:59:55.657261 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 04:59:55.657261 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 04:59:55.658248 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 04:59:55.658248 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 30 04:59:55.658248 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 30 04:59:55.658248 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 30 04:59:55.658248 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 30 04:59:55.658248 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 30 04:59:55.658248 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 30 04:59:55.658248 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 30 04:59:55.658248 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 30 04:59:55.658248 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 30 04:59:55.658248 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 30 04:59:55.658248 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 30 04:59:55.658248 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 30 04:59:55.658248 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 30 04:59:55.658248 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 30 04:59:55.658248 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 30 04:59:55.658248 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 30 04:59:55.658248 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 30 04:59:55.658248 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 30 04:59:55.659856 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 30 04:59:55.659856 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 30 04:59:55.659856 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 30 04:59:55.659856 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 30 04:59:55.659856 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6fd7ebda-bc69-483c-879a-526a1a08323e could not be found. Jul 30 04:59:55.659856 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 04:59:55.659856 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 04:59:55.659856 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 04:59:55.659856 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 04:59:55.659856 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 04:59:55.659856 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 04:59:55.659856 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 04:59:55.659856 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 04:59:55.659856 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 04:59:55.659856 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 04:59:55.659856 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 04:59:55.659856 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 04:59:55.659856 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 30 04:59:55.659856 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 04:59:55.661020 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6fd7ebda-bc69-483c-879a-526a1a08323e could not be found. Jul 30 04:59:55.661020 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 04:59:55.661020 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 04:59:55.661020 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 04:59:55.661020 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 04:59:55.661020 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 04:59:55.661020 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 04:59:55.661020 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 04:59:55.661020 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 04:59:55.661020 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6fd7ebda-bc69-483c-879a-526a1a08323e could not be found. Jul 30 04:59:55.661020 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 04:59:55.661020 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-01755202-c011-4935-af20-addae73f879d tempest-VolumesNegativeTest-703696501 tempest-VolumesNegativeTest-703696501-project] Returning 404 to user: Volume 6fd7ebda-bc69-483c-879a-526a1a08323e could not be found. {{(pid=117886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 04:59:55.661020 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-01755202-c011-4935-af20-addae73f879d tempest-VolumesNegativeTest-703696501 tempest-VolumesNegativeTest-703696501-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/6fd7ebda-bc69-483c-879a-526a1a08323e" status: 404 len: 109 microversion: 2.1 time: 0.057825 Jul 30 04:59:55.661020 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 129/243] 10.222.0.20 () {58 vars in 1248 bytes} [Sat Jul 30 04:59:55 2022] DELETE /compute/v2.1/os-volumes/6fd7ebda-bc69-483c-879a-526a1a08323e => generated 109 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 04:59:55.684304 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-622630d8-5254-4634-9ae3-0fd184bcad6f tempest-VolumesNegativeTest-703696501 tempest-VolumesNegativeTest-703696501-project] Calling method '.version_select at 0x7f2db43a9160>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:55.727328 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.wsgi [None req-622630d8-5254-4634-9ae3-0fd184bcad6f tempest-VolumesNegativeTest-703696501 tempest-VolumesNegativeTest-703696501-project] HTTP exception thrown: Volume a0d315bf-51e3-4c08-9525-ad612dbc1829 could not be found. Jul 30 04:59:55.729340 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-622630d8-5254-4634-9ae3-0fd184bcad6f tempest-VolumesNegativeTest-703696501 tempest-VolumesNegativeTest-703696501-project] Request method failure captured: Jul 30 04:59:55.729340 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: request: GET /compute/v2.1/os-volumes/a0d315bf-51e3-4c08-9525-ad612dbc1829 HTTP/1.1 Jul 30 04:59:55.729340 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Accept: application/json Jul 30 04:59:55.729340 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Accept-Encoding: identity Jul 30 04:59:55.729340 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Connection: close Jul 30 04:59:55.729340 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Content-Length: 0 Jul 30 04:59:55.729340 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Content-Type: application/json Jul 30 04:59:55.729340 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Host: 10.222.0.20 Jul 30 04:59:55.729340 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Openstack-System-Scope: None Jul 30 04:59:55.729340 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: User-Agent: python-urllib3/1.26.10 Jul 30 04:59:55.729340 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Auth-Token: gAAAAABi5LrLsVClOUJOSkpxhSF-P1ntfRirb27WlAplgTG0ZC7q-Rc9zHkqA2rXOnb_uxL5qxunTwFKGoK_NrqSBS5n_W2w7x37Kv2dKQTxBc_LIxgNxLKGq2gJIbMeSZIU_nUMeSnbwOt2Oe6U_zZkUDWneiPjcj-R7k0jGUYVm69Pp30ttg4 Jul 30 04:59:55.729340 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Domain-Id: None Jul 30 04:59:55.729340 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Domain-Name: None Jul 30 04:59:55.729340 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Identity-Status: Confirmed Jul 30 04:59:55.729340 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Is-Admin-Project: True Jul 30 04:59:55.729340 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Project-Domain-Id: default Jul 30 04:59:55.729340 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Project-Domain-Name: Default Jul 30 04:59:55.729340 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Project-Id: c99e869e8f634c5b86d9939d3d168657 Jul 30 04:59:55.729340 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Project-Name: tempest-VolumesNegativeTest-703696501 Jul 30 04:59:55.729340 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Role: member,reader Jul 30 04:59:55.729340 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Roles: member,reader Jul 30 04:59:55.730616 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c99e869e8f634c5b86d9939d3d168657"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c99e869e8f634c5b86d9939d3d168657"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c99e869e8f634c5b86d9939d3d168657"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c99e869e8f634c5b86d9939d3d168657"}]}] Jul 30 04:59:55.730616 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Tenant: tempest-VolumesNegativeTest-703696501 Jul 30 04:59:55.730616 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Tenant-Id: c99e869e8f634c5b86d9939d3d168657 Jul 30 04:59:55.730616 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Tenant-Name: tempest-VolumesNegativeTest-703696501 Jul 30 04:59:55.730616 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User: tempest-VolumesNegativeTest-703696501-project Jul 30 04:59:55.730616 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User-Domain-Id: default Jul 30 04:59:55.730616 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User-Domain-Name: Default Jul 30 04:59:55.730616 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User-Id: 4412c814ea3d4ed39281696df34ededa Jul 30 04:59:55.730616 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User-Name: tempest-VolumesNegativeTest-703696501-project Jul 30 04:59:55.730616 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: method: Jul 30 04:59:55.730616 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: exception: Volume a0d315bf-51e3-4c08-9525-ad612dbc1829 could not be found. Jul 30 04:59:55.730616 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: action_args: {'id': 'a0d315bf-51e3-4c08-9525-ad612dbc1829'} Jul 30 04:59:55.730616 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 04:59:55.731520 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 04:59:55.731520 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 30 04:59:55.731520 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 30 04:59:55.731520 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 30 04:59:55.731520 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 30 04:59:55.731520 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 30 04:59:55.731520 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 30 04:59:55.731520 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 30 04:59:55.731520 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 30 04:59:55.731520 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 30 04:59:55.731520 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 30 04:59:55.731520 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 30 04:59:55.731520 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 30 04:59:55.731520 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 30 04:59:55.731520 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 30 04:59:55.731520 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a0d315bf-51e3-4c08-9525-ad612dbc1829 could not be found. (HTTP 404) (Request-ID: req-df8f493a-5a0d-40a8-856f-502b5c91469c) Jul 30 04:59:55.731520 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 04:59:55.731520 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 04:59:55.731520 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 04:59:55.732733 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 04:59:55.732733 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 30 04:59:55.732733 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 30 04:59:55.732733 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 30 04:59:55.732733 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 30 04:59:55.732733 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 30 04:59:55.732733 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 30 04:59:55.732733 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 30 04:59:55.732733 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 30 04:59:55.732733 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 30 04:59:55.732733 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 30 04:59:55.732733 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 30 04:59:55.732733 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 30 04:59:55.732733 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 30 04:59:55.732733 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 30 04:59:55.732733 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 30 04:59:55.732733 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 30 04:59:55.732733 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 30 04:59:55.732733 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 30 04:59:55.733909 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 30 04:59:55.733909 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 30 04:59:55.733909 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 30 04:59:55.733909 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 30 04:59:55.733909 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a0d315bf-51e3-4c08-9525-ad612dbc1829 could not be found. Jul 30 04:59:55.733909 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 04:59:55.733909 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 04:59:55.733909 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 04:59:55.733909 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 04:59:55.733909 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 04:59:55.733909 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 04:59:55.733909 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 04:59:55.733909 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 04:59:55.733909 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 04:59:55.733909 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 04:59:55.733909 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 04:59:55.733909 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 04:59:55.733909 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 30 04:59:55.733909 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 04:59:55.734940 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a0d315bf-51e3-4c08-9525-ad612dbc1829 could not be found. Jul 30 04:59:55.734940 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 04:59:55.734940 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 04:59:55.734940 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 04:59:55.734940 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 04:59:55.734940 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 04:59:55.734940 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 04:59:55.734940 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 04:59:55.734940 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 04:59:55.734940 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a0d315bf-51e3-4c08-9525-ad612dbc1829 could not be found. Jul 30 04:59:55.734940 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 04:59:55.734940 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-622630d8-5254-4634-9ae3-0fd184bcad6f tempest-VolumesNegativeTest-703696501 tempest-VolumesNegativeTest-703696501-project] Returning 404 to user: Volume a0d315bf-51e3-4c08-9525-ad612dbc1829 could not be found. {{(pid=117886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 04:59:55.734940 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-622630d8-5254-4634-9ae3-0fd184bcad6f tempest-VolumesNegativeTest-703696501 tempest-VolumesNegativeTest-703696501-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/a0d315bf-51e3-4c08-9525-ad612dbc1829" status: 404 len: 109 microversion: 2.1 time: 0.056509 Jul 30 04:59:55.740915 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 130/244] 10.222.0.20 () {58 vars in 1245 bytes} [Sat Jul 30 04:59:55 2022] GET /compute/v2.1/os-volumes/a0d315bf-51e3-4c08-9525-ad612dbc1829 => generated 109 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 04:59:55.864008 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-ebdcb355-2472-41c4-bc71-ec39e47052c5 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:55.872656 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-ebdcb355-2472-41c4-bc71-ec39e47052c5 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c" status: 200 len: 1522 microversion: 2.1 time: 0.236097 Jul 30 04:59:55.874513 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 115/245] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:59:55 2022] GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c => generated 1522 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 04:59:56.252753 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-03f79e24-404b-4f2c-b8ce-9c3cba656ba0 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:56.254082 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-03f79e24-404b-4f2c-b8ce-9c3cba656ba0 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] [instance: 1b4b194e-e03a-474d-8f65-701f6622fdb0] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:56.263301 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-03f79e24-404b-4f2c-b8ce-9c3cba656ba0 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:56.263973 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-03f79e24-404b-4f2c-b8ce-9c3cba656ba0 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:56.264758 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-03f79e24-404b-4f2c-b8ce-9c3cba656ba0 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:56.265541 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-03f79e24-404b-4f2c-b8ce-9c3cba656ba0 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:56.346887 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-03f79e24-404b-4f2c-b8ce-9c3cba656ba0 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929d7587f49445ed9c86d53a1d888648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc01f77fe9745369cef62c8379f9209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:56.356940 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-03f79e24-404b-4f2c-b8ce-9c3cba656ba0 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] 10.222.0.20 "GET /compute/v2.1/servers/1b4b194e-e03a-474d-8f65-701f6622fdb0" status: 200 len: 1267 microversion: 2.1 time: 0.111021 Jul 30 04:59:56.357397 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 131/246] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:59:56 2022] GET /compute/v2.1/servers/1b4b194e-e03a-474d-8f65-701f6622fdb0 => generated 1267 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:59:56.898521 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-a22cd1db-44eb-4e06-8bf6-a2cf707a18d3 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:56.900847 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-a22cd1db-44eb-4e06-8bf6-a2cf707a18d3 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 7b5e218d-8660-4d90-90d1-9c8e50a66a7c] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:56.908409 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a22cd1db-44eb-4e06-8bf6-a2cf707a18d3 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:56.909084 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a22cd1db-44eb-4e06-8bf6-a2cf707a18d3 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:56.910858 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a22cd1db-44eb-4e06-8bf6-a2cf707a18d3 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:56.911519 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a22cd1db-44eb-4e06-8bf6-a2cf707a18d3 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:57.146204 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-a22cd1db-44eb-4e06-8bf6-a2cf707a18d3 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:57.150794 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell1:SELECT=100 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 04:59:57.156430 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-a22cd1db-44eb-4e06-8bf6-a2cf707a18d3 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c" status: 200 len: 1522 microversion: 2.1 time: 0.264879 Jul 30 04:59:57.157083 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 116/247] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:59:56 2022] GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c => generated 1522 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:59:57.390790 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-72240618-78df-4c09-9633-55b9d0853693 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:57.391400 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-72240618-78df-4c09-9633-55b9d0853693 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] [instance: 1b4b194e-e03a-474d-8f65-701f6622fdb0] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:57.398132 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-72240618-78df-4c09-9633-55b9d0853693 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:57.398621 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-72240618-78df-4c09-9633-55b9d0853693 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:57.399762 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-72240618-78df-4c09-9633-55b9d0853693 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:57.400348 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-72240618-78df-4c09-9633-55b9d0853693 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:57.472234 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-72240618-78df-4c09-9633-55b9d0853693 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929d7587f49445ed9c86d53a1d888648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc01f77fe9745369cef62c8379f9209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:57.479656 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-72240618-78df-4c09-9633-55b9d0853693 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] 10.222.0.20 "GET /compute/v2.1/servers/1b4b194e-e03a-474d-8f65-701f6622fdb0" status: 200 len: 1273 microversion: 2.1 time: 0.093171 Jul 30 04:59:57.480371 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 132/248] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:59:57 2022] GET /compute/v2.1/servers/1b4b194e-e03a-474d-8f65-701f6622fdb0 => generated 1273 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:59:58.181892 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-4d49c647-da4d-48f3-a33f-f3dadcda1feb tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:58.182972 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-4d49c647-da4d-48f3-a33f-f3dadcda1feb tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 7b5e218d-8660-4d90-90d1-9c8e50a66a7c] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:58.191207 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4d49c647-da4d-48f3-a33f-f3dadcda1feb tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:58.193470 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4d49c647-da4d-48f3-a33f-f3dadcda1feb tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:58.195092 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4d49c647-da4d-48f3-a33f-f3dadcda1feb tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:58.195823 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4d49c647-da4d-48f3-a33f-f3dadcda1feb tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:58.507709 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-0398656a-6377-436b-b8bf-5a962ab35d65 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:58.509041 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-0398656a-6377-436b-b8bf-5a962ab35d65 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] [instance: 1b4b194e-e03a-474d-8f65-701f6622fdb0] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:58.517610 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0398656a-6377-436b-b8bf-5a962ab35d65 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:58.518253 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0398656a-6377-436b-b8bf-5a962ab35d65 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:58.519918 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0398656a-6377-436b-b8bf-5a962ab35d65 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:58.520565 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0398656a-6377-436b-b8bf-5a962ab35d65 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:58.547626 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-4d49c647-da4d-48f3-a33f-f3dadcda1feb tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:58.558928 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-4d49c647-da4d-48f3-a33f-f3dadcda1feb tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c" status: 200 len: 1522 microversion: 2.1 time: 0.381018 Jul 30 04:59:58.559513 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 117/249] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:59:58 2022] GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c => generated 1522 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:59:58.659843 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-316779db-e52e-4dd9-b692-90736f63afc9 req-d071ac89-a21d-490d-9fae-339ae383d629 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b4b194e-e03a-474d-8f65-701f6622fdb0", "tag": "8504d07b-9873-461b-a383-5d5c53437dee"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 04:59:58.671914 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-316779db-e52e-4dd9-b692-90736f63afc9 req-d071ac89-a21d-490d-9fae-339ae383d629 service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:58.672352 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-316779db-e52e-4dd9-b692-90736f63afc9 req-d071ac89-a21d-490d-9fae-339ae383d629 service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:58.689731 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-316779db-e52e-4dd9-b692-90736f63afc9 req-d071ac89-a21d-490d-9fae-339ae383d629 service nova] Creating event network-changed:8504d07b-9873-461b-a383-5d5c53437dee for instance 1b4b194e-e03a-474d-8f65-701f6622fdb0 on hv-cinder-85127 Jul 30 04:59:58.696416 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-316779db-e52e-4dd9-b692-90736f63afc9 req-d071ac89-a21d-490d-9fae-339ae383d629 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040311 Jul 30 04:59:58.697286 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 118/250] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Jul 30 04:59:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 04:59:58.787435 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-0398656a-6377-436b-b8bf-5a962ab35d65 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929d7587f49445ed9c86d53a1d888648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc01f77fe9745369cef62c8379f9209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:58.805023 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-0398656a-6377-436b-b8bf-5a962ab35d65 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] 10.222.0.20 "GET /compute/v2.1/servers/1b4b194e-e03a-474d-8f65-701f6622fdb0" status: 200 len: 1315 microversion: 2.1 time: 0.303616 Jul 30 04:59:58.815885 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 133/251] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:59:58 2022] GET /compute/v2.1/servers/1b4b194e-e03a-474d-8f65-701f6622fdb0 => generated 1315 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:59:59.582272 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-dab83a62-44e6-4a01-b1f9-85202984273f tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:59.583001 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-dab83a62-44e6-4a01-b1f9-85202984273f tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 7b5e218d-8660-4d90-90d1-9c8e50a66a7c] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:59.589664 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-dab83a62-44e6-4a01-b1f9-85202984273f tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:59.590074 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-dab83a62-44e6-4a01-b1f9-85202984273f tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:59.590883 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-dab83a62-44e6-4a01-b1f9-85202984273f tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:59.591319 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-dab83a62-44e6-4a01-b1f9-85202984273f tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:59.755661 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-dab83a62-44e6-4a01-b1f9-85202984273f tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 04:59:59.763433 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-dab83a62-44e6-4a01-b1f9-85202984273f tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c" status: 200 len: 1522 microversion: 2.1 time: 0.186378 Jul 30 04:59:59.764310 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 119/252] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:59:59 2022] GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 04:59:59.827213 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-e0f9edff-c3b0-441d-a719-2d499f51b035 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 04:59:59.827911 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-e0f9edff-c3b0-441d-a719-2d499f51b035 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] [instance: 1b4b194e-e03a-474d-8f65-701f6622fdb0] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 04:59:59.834645 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e0f9edff-c3b0-441d-a719-2d499f51b035 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:59.835111 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e0f9edff-c3b0-441d-a719-2d499f51b035 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:59.835878 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e0f9edff-c3b0-441d-a719-2d499f51b035 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 04:59:59.836485 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e0f9edff-c3b0-441d-a719-2d499f51b035 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 04:59:59.840712 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:00:00.020237 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-e0f9edff-c3b0-441d-a719-2d499f51b035 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929d7587f49445ed9c86d53a1d888648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc01f77fe9745369cef62c8379f9209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:00.028841 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-e0f9edff-c3b0-441d-a719-2d499f51b035 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] 10.222.0.20 "GET /compute/v2.1/servers/1b4b194e-e03a-474d-8f65-701f6622fdb0" status: 200 len: 1315 microversion: 2.1 time: 0.205771 Jul 30 05:00:00.029488 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 134/253] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 04:59:59 2022] GET /compute/v2.1/servers/1b4b194e-e03a-474d-8f65-701f6622fdb0 => generated 1315 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:00:00.785702 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-89f5805e-097a-443f-b819-032657365b50 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:00.786326 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-89f5805e-097a-443f-b819-032657365b50 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 7b5e218d-8660-4d90-90d1-9c8e50a66a7c] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:00.792754 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-89f5805e-097a-443f-b819-032657365b50 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:00.793731 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-89f5805e-097a-443f-b819-032657365b50 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:00.794496 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-89f5805e-097a-443f-b819-032657365b50 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:00.795356 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-89f5805e-097a-443f-b819-032657365b50 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:00.993989 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-89f5805e-097a-443f-b819-032657365b50 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:01.011847 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-89f5805e-097a-443f-b819-032657365b50 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c" status: 200 len: 1522 microversion: 2.1 time: 0.230670 Jul 30 05:00:01.013054 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 120/254] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:00 2022] GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c => generated 1522 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:00:01.058847 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-67d021dc-fec0-4fda-bb76-8094244a0e9f tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:01.060231 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-67d021dc-fec0-4fda-bb76-8094244a0e9f tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] [instance: 1b4b194e-e03a-474d-8f65-701f6622fdb0] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:01.067374 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-67d021dc-fec0-4fda-bb76-8094244a0e9f tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:01.068221 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-67d021dc-fec0-4fda-bb76-8094244a0e9f tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:01.069106 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-67d021dc-fec0-4fda-bb76-8094244a0e9f tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:01.069634 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-67d021dc-fec0-4fda-bb76-8094244a0e9f tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:01.223962 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-67d021dc-fec0-4fda-bb76-8094244a0e9f tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929d7587f49445ed9c86d53a1d888648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc01f77fe9745369cef62c8379f9209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:01.233970 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-67d021dc-fec0-4fda-bb76-8094244a0e9f tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] 10.222.0.20 "GET /compute/v2.1/servers/1b4b194e-e03a-474d-8f65-701f6622fdb0" status: 200 len: 1315 microversion: 2.1 time: 0.178798 Jul 30 05:00:01.247069 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 135/255] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:01 2022] GET /compute/v2.1/servers/1b4b194e-e03a-474d-8f65-701f6622fdb0 => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:00:02.033237 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-c906ed47-656a-470b-a398-c0887c1a65ca tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:02.035019 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-c906ed47-656a-470b-a398-c0887c1a65ca tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 7b5e218d-8660-4d90-90d1-9c8e50a66a7c] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:02.041940 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c906ed47-656a-470b-a398-c0887c1a65ca tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:02.042387 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c906ed47-656a-470b-a398-c0887c1a65ca tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:02.043657 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c906ed47-656a-470b-a398-c0887c1a65ca tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:02.044097 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c906ed47-656a-470b-a398-c0887c1a65ca tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:02.204758 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-c906ed47-656a-470b-a398-c0887c1a65ca tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:02.213456 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-c906ed47-656a-470b-a398-c0887c1a65ca tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c" status: 200 len: 1522 microversion: 2.1 time: 0.183995 Jul 30 05:00:02.222388 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 121/256] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:02 2022] GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 05:00:02.262772 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-99fb6e7f-bf26-4a01-ba1b-163320a441e3 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:02.263897 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-99fb6e7f-bf26-4a01-ba1b-163320a441e3 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] [instance: 1b4b194e-e03a-474d-8f65-701f6622fdb0] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:02.270667 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-99fb6e7f-bf26-4a01-ba1b-163320a441e3 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:02.271125 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-99fb6e7f-bf26-4a01-ba1b-163320a441e3 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:02.271908 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-99fb6e7f-bf26-4a01-ba1b-163320a441e3 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:02.272345 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-99fb6e7f-bf26-4a01-ba1b-163320a441e3 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:02.432525 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-99fb6e7f-bf26-4a01-ba1b-163320a441e3 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929d7587f49445ed9c86d53a1d888648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc01f77fe9745369cef62c8379f9209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:02.443784 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-99fb6e7f-bf26-4a01-ba1b-163320a441e3 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] 10.222.0.20 "GET /compute/v2.1/servers/1b4b194e-e03a-474d-8f65-701f6622fdb0" status: 200 len: 1315 microversion: 2.1 time: 0.183730 Jul 30 05:00:02.444363 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 136/257] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:02 2022] GET /compute/v2.1/servers/1b4b194e-e03a-474d-8f65-701f6622fdb0 => generated 1315 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:00:03.235720 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-b477da94-ae63-4fe5-8cd3-99c33ec1d9e5 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:03.236351 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-b477da94-ae63-4fe5-8cd3-99c33ec1d9e5 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 7b5e218d-8660-4d90-90d1-9c8e50a66a7c] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:03.242875 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b477da94-ae63-4fe5-8cd3-99c33ec1d9e5 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:03.243273 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b477da94-ae63-4fe5-8cd3-99c33ec1d9e5 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:03.244039 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b477da94-ae63-4fe5-8cd3-99c33ec1d9e5 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:03.244478 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b477da94-ae63-4fe5-8cd3-99c33ec1d9e5 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:03.380791 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-b477da94-ae63-4fe5-8cd3-99c33ec1d9e5 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:03.388268 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-b477da94-ae63-4fe5-8cd3-99c33ec1d9e5 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c" status: 200 len: 1522 microversion: 2.1 time: 0.156367 Jul 30 05:00:03.397478 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 122/258] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:03 2022] GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:00:03.468384 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-94aa5fe4-ec70-4dea-aec0-ebb35619bb40 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:03.469212 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-94aa5fe4-ec70-4dea-aec0-ebb35619bb40 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] [instance: 1b4b194e-e03a-474d-8f65-701f6622fdb0] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:03.475474 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-94aa5fe4-ec70-4dea-aec0-ebb35619bb40 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:03.475971 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-94aa5fe4-ec70-4dea-aec0-ebb35619bb40 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:03.476813 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-94aa5fe4-ec70-4dea-aec0-ebb35619bb40 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:03.477319 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-94aa5fe4-ec70-4dea-aec0-ebb35619bb40 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:03.624650 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-94aa5fe4-ec70-4dea-aec0-ebb35619bb40 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929d7587f49445ed9c86d53a1d888648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc01f77fe9745369cef62c8379f9209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:03.632742 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-94aa5fe4-ec70-4dea-aec0-ebb35619bb40 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] 10.222.0.20 "GET /compute/v2.1/servers/1b4b194e-e03a-474d-8f65-701f6622fdb0" status: 200 len: 1315 microversion: 2.1 time: 0.168441 Jul 30 05:00:03.633512 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 137/259] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:03 2022] GET /compute/v2.1/servers/1b4b194e-e03a-474d-8f65-701f6622fdb0 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:00:04.410755 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-159faa31-af03-492c-a53b-88d42bef965f tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:04.411372 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-159faa31-af03-492c-a53b-88d42bef965f tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 7b5e218d-8660-4d90-90d1-9c8e50a66a7c] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:04.418282 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-159faa31-af03-492c-a53b-88d42bef965f tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:04.418755 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-159faa31-af03-492c-a53b-88d42bef965f tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:04.419506 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-159faa31-af03-492c-a53b-88d42bef965f tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:04.420150 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-159faa31-af03-492c-a53b-88d42bef965f tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:04.588944 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-159faa31-af03-492c-a53b-88d42bef965f tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:04.610491 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-159faa31-af03-492c-a53b-88d42bef965f tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c" status: 200 len: 1522 microversion: 2.1 time: 0.205033 Jul 30 05:00:04.612871 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 123/260] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:04 2022] GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c => generated 1522 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:00:04.653171 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-1ae8170e-9a6b-4f9b-809f-52e17e1fe9e8 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:04.653877 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-1ae8170e-9a6b-4f9b-809f-52e17e1fe9e8 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] [instance: 1b4b194e-e03a-474d-8f65-701f6622fdb0] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:04.664456 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1ae8170e-9a6b-4f9b-809f-52e17e1fe9e8 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:04.665353 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1ae8170e-9a6b-4f9b-809f-52e17e1fe9e8 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:04.667125 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1ae8170e-9a6b-4f9b-809f-52e17e1fe9e8 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:04.669441 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1ae8170e-9a6b-4f9b-809f-52e17e1fe9e8 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:04.865594 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-a4e53652-049e-48f0-8874-e1e1617c7178 req-0c7bbc44-ad4f-46c9-aaaa-7d86ce0b2fbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b4b194e-e03a-474d-8f65-701f6622fdb0", "name": "network-vif-plugged", "status": "completed", "tag": "8504d07b-9873-461b-a383-5d5c53437dee"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:00:04.875388 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-a4e53652-049e-48f0-8874-e1e1617c7178 req-0c7bbc44-ad4f-46c9-aaaa-7d86ce0b2fbb service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:04.876065 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-a4e53652-049e-48f0-8874-e1e1617c7178 req-0c7bbc44-ad4f-46c9-aaaa-7d86ce0b2fbb service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:04.888290 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-a4e53652-049e-48f0-8874-e1e1617c7178 req-0c7bbc44-ad4f-46c9-aaaa-7d86ce0b2fbb service nova] Creating event network-vif-plugged:8504d07b-9873-461b-a383-5d5c53437dee for instance 1b4b194e-e03a-474d-8f65-701f6622fdb0 on hv-cinder-85127 Jul 30 05:00:04.893655 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-a4e53652-049e-48f0-8874-e1e1617c7178 req-0c7bbc44-ad4f-46c9-aaaa-7d86ce0b2fbb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032361 Jul 30 05:00:04.894545 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 124/261] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Jul 30 05:00:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 05:00:04.898225 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-1ae8170e-9a6b-4f9b-809f-52e17e1fe9e8 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929d7587f49445ed9c86d53a1d888648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc01f77fe9745369cef62c8379f9209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:04.907437 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-1ae8170e-9a6b-4f9b-809f-52e17e1fe9e8 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] 10.222.0.20 "GET /compute/v2.1/servers/1b4b194e-e03a-474d-8f65-701f6622fdb0" status: 200 len: 1315 microversion: 2.1 time: 0.258071 Jul 30 05:00:04.910250 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 138/262] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:04 2022] GET /compute/v2.1/servers/1b4b194e-e03a-474d-8f65-701f6622fdb0 => generated 1315 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:00:05.630534 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell0:SELECT=6 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:00:05.635987 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-1a69ed2c-faa5-4d52-a2ca-10a6a8289bb6 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:05.636924 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-1a69ed2c-faa5-4d52-a2ca-10a6a8289bb6 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 7b5e218d-8660-4d90-90d1-9c8e50a66a7c] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:05.644072 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1a69ed2c-faa5-4d52-a2ca-10a6a8289bb6 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:05.644608 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1a69ed2c-faa5-4d52-a2ca-10a6a8289bb6 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:05.645586 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1a69ed2c-faa5-4d52-a2ca-10a6a8289bb6 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:05.646071 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1a69ed2c-faa5-4d52-a2ca-10a6a8289bb6 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:05.780427 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-1a69ed2c-faa5-4d52-a2ca-10a6a8289bb6 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:05.789630 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-1a69ed2c-faa5-4d52-a2ca-10a6a8289bb6 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c" status: 200 len: 1522 microversion: 2.1 time: 0.160053 Jul 30 05:00:05.790195 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 125/263] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:05 2022] GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:00:05.931932 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-7fa04b4a-d147-41e9-ba51-b09302e8c4da tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:05.933111 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-7fa04b4a-d147-41e9-ba51-b09302e8c4da tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] [instance: 1b4b194e-e03a-474d-8f65-701f6622fdb0] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:05.941220 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell0:SELECT=2 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:00:05.941917 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell0:SELECT=6 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:00:05.944161 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7fa04b4a-d147-41e9-ba51-b09302e8c4da tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:05.944467 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7fa04b4a-d147-41e9-ba51-b09302e8c4da tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:05.945384 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7fa04b4a-d147-41e9-ba51-b09302e8c4da tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:05.945790 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7fa04b4a-d147-41e9-ba51-b09302e8c4da tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:06.105167 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-7fa04b4a-d147-41e9-ba51-b09302e8c4da tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929d7587f49445ed9c86d53a1d888648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc01f77fe9745369cef62c8379f9209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:06.113330 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-7fa04b4a-d147-41e9-ba51-b09302e8c4da tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] 10.222.0.20 "GET /compute/v2.1/servers/1b4b194e-e03a-474d-8f65-701f6622fdb0" status: 200 len: 1315 microversion: 2.1 time: 0.185822 Jul 30 05:00:06.114010 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 139/264] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:05 2022] GET /compute/v2.1/servers/1b4b194e-e03a-474d-8f65-701f6622fdb0 => generated 1315 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:00:06.795963 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-bcb1962a-7cc3-4271-a4b8-d56b415b6934 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-33150492", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-157398780", "security_groups": [{"name": "tempest-secgroup-smoke-345229865"}], "networks": [{"uuid": "ba00ca49-96d9-4fff-b920-6f01cfda6037"}], "block_device_mapping_v2": [{"uuid": "1e039a9b-4b5d-4d2a-9ee4-fe61c5478a0b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:00:06.811278 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-e9cc66e4-d72c-4253-af80-913bb0b7c84b tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:06.811893 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-e9cc66e4-d72c-4253-af80-913bb0b7c84b tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 7b5e218d-8660-4d90-90d1-9c8e50a66a7c] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:06.819066 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e9cc66e4-d72c-4253-af80-913bb0b7c84b tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:06.819452 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e9cc66e4-d72c-4253-af80-913bb0b7c84b tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:06.820218 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e9cc66e4-d72c-4253-af80-913bb0b7c84b tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:06.820653 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e9cc66e4-d72c-4253-af80-913bb0b7c84b tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:06.917927 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.network.neutron [None req-bcb1962a-7cc3-4271-a4b8-d56b415b6934 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] validate_networks() for [('ba00ca49-96d9-4fff-b920-6f01cfda6037', None, None, None, None, None)] {{(pid=117885) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 05:00:06.959296 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-e9cc66e4-d72c-4253-af80-913bb0b7c84b tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:06.966960 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-e9cc66e4-d72c-4253-af80-913bb0b7c84b tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c" status: 200 len: 1502 microversion: 2.1 time: 0.159532 Jul 30 05:00:06.967522 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 140/265] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:06 2022] GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c => generated 1502 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 05:00:06.987132 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-dd0353e1-989e-48f4-8b54-1b897c46ca05 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:06.987838 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-dd0353e1-989e-48f4-8b54-1b897c46ca05 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: cc0c06a0-156a-4cee-8ff7-92ab582bc4a1] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:06.993925 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-dd0353e1-989e-48f4-8b54-1b897c46ca05 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:06.994315 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-dd0353e1-989e-48f4-8b54-1b897c46ca05 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:06.995118 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-dd0353e1-989e-48f4-8b54-1b897c46ca05 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:06.995559 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-dd0353e1-989e-48f4-8b54-1b897c46ca05 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:07.138799 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-dd0353e1-989e-48f4-8b54-1b897c46ca05 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:07.151867 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-dd0353e1-989e-48f4-8b54-1b897c46ca05 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0c06a0-156a-4cee-8ff7-92ab582bc4a1" status: 200 len: 1517 microversion: 2.1 time: 0.168538 Jul 30 05:00:07.152849 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 141/266] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:06 2022] GET /compute/v2.1/servers/cc0c06a0-156a-4cee-8ff7-92ab582bc4a1 => generated 1517 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 05:00:07.158268 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-5707f3ee-3ba7-46b8-bcbb-5c193c74b24c tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:07.159570 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-5707f3ee-3ba7-46b8-bcbb-5c193c74b24c tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] [instance: 1b4b194e-e03a-474d-8f65-701f6622fdb0] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:07.165958 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5707f3ee-3ba7-46b8-bcbb-5c193c74b24c tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:07.166704 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5707f3ee-3ba7-46b8-bcbb-5c193c74b24c tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:07.168063 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5707f3ee-3ba7-46b8-bcbb-5c193c74b24c tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:07.168741 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5707f3ee-3ba7-46b8-bcbb-5c193c74b24c tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:07.354587 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-5707f3ee-3ba7-46b8-bcbb-5c193c74b24c tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929d7587f49445ed9c86d53a1d888648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc01f77fe9745369cef62c8379f9209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:07.365996 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-5707f3ee-3ba7-46b8-bcbb-5c193c74b24c tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] 10.222.0.20 "GET /compute/v2.1/servers/1b4b194e-e03a-474d-8f65-701f6622fdb0" status: 200 len: 1315 microversion: 2.1 time: 0.208890 Jul 30 05:00:07.366886 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 142/267] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:07 2022] GET /compute/v2.1/servers/1b4b194e-e03a-474d-8f65-701f6622fdb0 => generated 1315 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:00:07.386861 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-bcb1962a-7cc3-4271-a4b8-d56b415b6934 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Flavor limits 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 05:00:07.387289 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-bcb1962a-7cc3-4271-a4b8-d56b415b6934 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Image limits 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 05:00:07.388008 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-bcb1962a-7cc3-4271-a4b8-d56b415b6934 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Flavor pref 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 05:00:07.389466 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-bcb1962a-7cc3-4271-a4b8-d56b415b6934 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Image pref 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 05:00:07.389901 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-bcb1962a-7cc3-4271-a4b8-d56b415b6934 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 05:00:07.401961 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-bcb1962a-7cc3-4271-a4b8-d56b415b6934 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:07.402415 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-bcb1962a-7cc3-4271-a4b8-d56b415b6934 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:07.403250 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-bcb1962a-7cc3-4271-a4b8-d56b415b6934 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:07.403694 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-bcb1962a-7cc3-4271-a4b8-d56b415b6934 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:07.424956 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.quota [None req-bcb1962a-7cc3-4271-a4b8-d56b415b6934 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Getting quotas for project 76df23454a3c4a9bb4f61b044ed5a426. Resources: {'ram', 'cores', 'instances'} {{(pid=117885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 05:00:07.429226 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.quota [None req-bcb1962a-7cc3-4271-a4b8-d56b415b6934 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Getting quotas for user b1a98edf8e5a4a22b3ae7d041b582b2d and project 76df23454a3c4a9bb4f61b044ed5a426. Resources: {'ram', 'cores', 'instances'} {{(pid=117885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 05:00:07.595372 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-bcb1962a-7cc3-4271-a4b8-d56b415b6934 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Going to run 1 instances... {{(pid=117885) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 05:00:07.598167 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-bcb1962a-7cc3-4271-a4b8-d56b415b6934 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] [instance: 99b497c8-e641-428a-94b6-86c21af5844f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1e039a9b-4b5d-4d2a-9ee4-fe61c5478a0b',volume_size=None,volume_type=None)] {{(pid=117885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 05:00:07.898710 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-bcb1962a-7cc3-4271-a4b8-d56b415b6934 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.106594 Jul 30 05:00:07.899783 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 126/268] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Jul 30 05:00:06 2022] POST /compute/v2.1/servers => generated 405 bytes in 1108 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 05:00:07.911089 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-8ea47f0b-47ed-4132-a10f-d04e7aac4f99 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:07.912144 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-8ea47f0b-47ed-4132-a10f-d04e7aac4f99 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] [instance: 99b497c8-e641-428a-94b6-86c21af5844f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:07.989920 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-8ea47f0b-47ed-4132-a10f-d04e7aac4f99 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a98edf8e5a4a22b3ae7d041b582b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76df23454a3c4a9bb4f61b044ed5a426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:07.999154 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-8ea47f0b-47ed-4132-a10f-d04e7aac4f99 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] 10.222.0.20 "GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f" status: 200 len: 1086 microversion: 2.1 time: 0.092756 Jul 30 05:00:08.010662 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 143/269] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:07 2022] GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f => generated 1086 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:00:08.388556 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-1e82c578-9f74-4643-a3ba-bc540ef46207 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:08.389174 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-1e82c578-9f74-4643-a3ba-bc540ef46207 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] [instance: 1b4b194e-e03a-474d-8f65-701f6622fdb0] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:08.398716 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1e82c578-9f74-4643-a3ba-bc540ef46207 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:08.399179 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1e82c578-9f74-4643-a3ba-bc540ef46207 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:08.399954 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1e82c578-9f74-4643-a3ba-bc540ef46207 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:08.400396 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1e82c578-9f74-4643-a3ba-bc540ef46207 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:08.723956 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-a30b762d-99a9-4b0f-9879-74f322bbd2e0 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:00:08.726215 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-a30b762d-99a9-4b0f-9879-74f322bbd2e0 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: cc0c06a0-156a-4cee-8ff7-92ab582bc4a1] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:08.732549 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a30b762d-99a9-4b0f-9879-74f322bbd2e0 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:08.732992 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a30b762d-99a9-4b0f-9879-74f322bbd2e0 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:08.733951 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a30b762d-99a9-4b0f-9879-74f322bbd2e0 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:08.734391 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a30b762d-99a9-4b0f-9879-74f322bbd2e0 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:08.752227 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-1e82c578-9f74-4643-a3ba-bc540ef46207 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929d7587f49445ed9c86d53a1d888648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc01f77fe9745369cef62c8379f9209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:08.758638 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.objects.instance [None req-a30b762d-99a9-4b0f-9879-74f322bbd2e0 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lazy-loading 'flavor' on Instance uuid cc0c06a0-156a-4cee-8ff7-92ab582bc4a1 {{(pid=117886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 05:00:08.759785 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-1e82c578-9f74-4643-a3ba-bc540ef46207 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] 10.222.0.20 "GET /compute/v2.1/servers/1b4b194e-e03a-474d-8f65-701f6622fdb0" status: 200 len: 1463 microversion: 2.1 time: 0.376603 Jul 30 05:00:08.760363 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 127/270] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:08 2022] GET /compute/v2.1/servers/1b4b194e-e03a-474d-8f65-701f6622fdb0 => generated 1463 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:00:08.811588 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-41bf20dd-4fc5-4313-99b6-a59be1333ad5 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:08.812183 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-41bf20dd-4fc5-4313-99b6-a59be1333ad5 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] [instance: 1b4b194e-e03a-474d-8f65-701f6622fdb0] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:08.819192 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-41bf20dd-4fc5-4313-99b6-a59be1333ad5 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:08.819745 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-41bf20dd-4fc5-4313-99b6-a59be1333ad5 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:08.820761 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-41bf20dd-4fc5-4313-99b6-a59be1333ad5 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:08.821244 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-41bf20dd-4fc5-4313-99b6-a59be1333ad5 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:08.842482 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-a30b762d-99a9-4b0f-9879-74f322bbd2e0 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "POST /compute/v2.1/servers/cc0c06a0-156a-4cee-8ff7-92ab582bc4a1/action" status: 200 len: 32 microversion: 2.1 time: 0.123173 Jul 30 05:00:08.843213 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 144/271] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Jul 30 05:00:08 2022] POST /compute/v2.1/servers/cc0c06a0-156a-4cee-8ff7-92ab582bc4a1/action => generated 32 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 30 05:00:08.853608 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-cb5ea6ed-8b73-47ba-a7e8-b9642176c0b6 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:08.853786 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-41bf20dd-4fc5-4313-99b6-a59be1333ad5 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] [instance: 1b4b194e-e03a-474d-8f65-701f6622fdb0] Going to try to terminate instance {{(pid=117885) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 05:00:08.854313 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-cb5ea6ed-8b73-47ba-a7e8-b9642176c0b6 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: cc0c06a0-156a-4cee-8ff7-92ab582bc4a1] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:08.860656 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cb5ea6ed-8b73-47ba-a7e8-b9642176c0b6 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:08.861305 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cb5ea6ed-8b73-47ba-a7e8-b9642176c0b6 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:08.862126 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cb5ea6ed-8b73-47ba-a7e8-b9642176c0b6 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:08.862591 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cb5ea6ed-8b73-47ba-a7e8-b9642176c0b6 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:08.979330 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-41bf20dd-4fc5-4313-99b6-a59be1333ad5 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1b4b194e-e03a-474d-8f65-701f6622fdb0" status: 204 len: 0 microversion: 2.1 time: 0.172220 Jul 30 05:00:08.984537 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 128/272] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Jul 30 05:00:08 2022] DELETE /compute/v2.1/servers/1b4b194e-e03a-474d-8f65-701f6622fdb0 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 30 05:00:08.993758 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-b9d24510-84a4-41b3-bb55-9d995ac37e46 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:08.996217 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-b9d24510-84a4-41b3-bb55-9d995ac37e46 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] [instance: 1b4b194e-e03a-474d-8f65-701f6622fdb0] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:09.014259 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b9d24510-84a4-41b3-bb55-9d995ac37e46 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:09.021627 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b9d24510-84a4-41b3-bb55-9d995ac37e46 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:09.023198 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b9d24510-84a4-41b3-bb55-9d995ac37e46 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:09.024112 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b9d24510-84a4-41b3-bb55-9d995ac37e46 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:09.064376 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-cb5ea6ed-8b73-47ba-a7e8-b9642176c0b6 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:09.073606 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-cb5ea6ed-8b73-47ba-a7e8-b9642176c0b6 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0c06a0-156a-4cee-8ff7-92ab582bc4a1" status: 200 len: 1523 microversion: 2.1 time: 0.224029 Jul 30 05:00:09.074238 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 145/273] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:08 2022] GET /compute/v2.1/servers/cc0c06a0-156a-4cee-8ff7-92ab582bc4a1 => generated 1523 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 05:00:09.079036 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-348c1f56-fd2c-4a88-bc78-f1d0607eefbf tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:09.079811 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-348c1f56-fd2c-4a88-bc78-f1d0607eefbf tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] [instance: 99b497c8-e641-428a-94b6-86c21af5844f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:09.087290 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-348c1f56-fd2c-4a88-bc78-f1d0607eefbf tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:09.087967 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-348c1f56-fd2c-4a88-bc78-f1d0607eefbf tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:09.088859 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-348c1f56-fd2c-4a88-bc78-f1d0607eefbf tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:09.089622 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-348c1f56-fd2c-4a88-bc78-f1d0607eefbf tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:09.185240 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-348c1f56-fd2c-4a88-bc78-f1d0607eefbf tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a98edf8e5a4a22b3ae7d041b582b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76df23454a3c4a9bb4f61b044ed5a426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:09.197351 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-348c1f56-fd2c-4a88-bc78-f1d0607eefbf tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] 10.222.0.20 "GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f" status: 200 len: 1192 microversion: 2.1 time: 0.121734 Jul 30 05:00:09.197928 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 146/274] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:09 2022] GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f => generated 1192 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:00:09.247409 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-b9d24510-84a4-41b3-bb55-9d995ac37e46 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929d7587f49445ed9c86d53a1d888648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc01f77fe9745369cef62c8379f9209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:09.255468 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-b9d24510-84a4-41b3-bb55-9d995ac37e46 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] 10.222.0.20 "GET /compute/v2.1/servers/1b4b194e-e03a-474d-8f65-701f6622fdb0" status: 200 len: 1469 microversion: 2.1 time: 0.269229 Jul 30 05:00:09.256218 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 129/275] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:08 2022] GET /compute/v2.1/servers/1b4b194e-e03a-474d-8f65-701f6622fdb0 => generated 1469 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:00:10.099037 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-e6bbc2c0-6a7d-4463-871d-6f04421e2971 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:10.099733 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-e6bbc2c0-6a7d-4463-871d-6f04421e2971 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: cc0c06a0-156a-4cee-8ff7-92ab582bc4a1] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:10.105929 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e6bbc2c0-6a7d-4463-871d-6f04421e2971 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:10.106466 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e6bbc2c0-6a7d-4463-871d-6f04421e2971 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:10.107328 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e6bbc2c0-6a7d-4463-871d-6f04421e2971 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:10.107940 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e6bbc2c0-6a7d-4463-871d-6f04421e2971 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:10.223178 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-d6aa0286-e773-4c81-af56-ce128ed744b0 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:10.225619 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-d6aa0286-e773-4c81-af56-ce128ed744b0 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] [instance: 99b497c8-e641-428a-94b6-86c21af5844f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:10.239261 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d6aa0286-e773-4c81-af56-ce128ed744b0 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:10.239712 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d6aa0286-e773-4c81-af56-ce128ed744b0 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:10.240567 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d6aa0286-e773-4c81-af56-ce128ed744b0 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:10.242316 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d6aa0286-e773-4c81-af56-ce128ed744b0 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:10.248212 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-e6bbc2c0-6a7d-4463-871d-6f04421e2971 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:10.256968 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-e6bbc2c0-6a7d-4463-871d-6f04421e2971 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0c06a0-156a-4cee-8ff7-92ab582bc4a1" status: 200 len: 1523 microversion: 2.1 time: 0.162449 Jul 30 05:00:10.257804 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 147/276] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:10 2022] GET /compute/v2.1/servers/cc0c06a0-156a-4cee-8ff7-92ab582bc4a1 => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:00:10.277239 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-20680e13-8314-411b-be99-a571e482b323 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:10.278212 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-20680e13-8314-411b-be99-a571e482b323 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] [instance: 1b4b194e-e03a-474d-8f65-701f6622fdb0] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:10.308229 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-20680e13-8314-411b-be99-a571e482b323 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:10.312113 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-20680e13-8314-411b-be99-a571e482b323 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:10.314991 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-20680e13-8314-411b-be99-a571e482b323 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:10.316610 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-20680e13-8314-411b-be99-a571e482b323 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:10.389226 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-d6aa0286-e773-4c81-af56-ce128ed744b0 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a98edf8e5a4a22b3ae7d041b582b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76df23454a3c4a9bb4f61b044ed5a426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:10.399250 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-d6aa0286-e773-4c81-af56-ce128ed744b0 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] 10.222.0.20 "GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f" status: 200 len: 1192 microversion: 2.1 time: 0.182034 Jul 30 05:00:10.400567 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 130/277] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:10 2022] GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f => generated 1192 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:00:10.540571 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-20680e13-8314-411b-be99-a571e482b323 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929d7587f49445ed9c86d53a1d888648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc01f77fe9745369cef62c8379f9209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:10.553684 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-20680e13-8314-411b-be99-a571e482b323 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] 10.222.0.20 "GET /compute/v2.1/servers/1b4b194e-e03a-474d-8f65-701f6622fdb0" status: 200 len: 1469 microversion: 2.1 time: 0.280295 Jul 30 05:00:10.554895 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 148/278] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:10 2022] GET /compute/v2.1/servers/1b4b194e-e03a-474d-8f65-701f6622fdb0 => generated 1469 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 05:00:11.280711 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-b3de28d4-29a4-4a31-86b9-1aeea5ab2225 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:11.281495 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-b3de28d4-29a4-4a31-86b9-1aeea5ab2225 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: cc0c06a0-156a-4cee-8ff7-92ab582bc4a1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:11.296423 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b3de28d4-29a4-4a31-86b9-1aeea5ab2225 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:11.300909 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b3de28d4-29a4-4a31-86b9-1aeea5ab2225 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:11.303710 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b3de28d4-29a4-4a31-86b9-1aeea5ab2225 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:11.304194 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b3de28d4-29a4-4a31-86b9-1aeea5ab2225 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:11.430368 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-738242c4-eebf-4df4-9fc8-5fb4fe93008a tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:11.431025 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-738242c4-eebf-4df4-9fc8-5fb4fe93008a tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] [instance: 99b497c8-e641-428a-94b6-86c21af5844f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:11.445913 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-738242c4-eebf-4df4-9fc8-5fb4fe93008a tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:11.446368 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-738242c4-eebf-4df4-9fc8-5fb4fe93008a tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:11.447557 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-738242c4-eebf-4df4-9fc8-5fb4fe93008a tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:11.448820 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-738242c4-eebf-4df4-9fc8-5fb4fe93008a tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:11.715464 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-b3de28d4-29a4-4a31-86b9-1aeea5ab2225 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:11.738022 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-b3de28d4-29a4-4a31-86b9-1aeea5ab2225 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0c06a0-156a-4cee-8ff7-92ab582bc4a1" status: 200 len: 1523 microversion: 2.1 time: 0.449662 Jul 30 05:00:11.739148 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 131/279] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:11 2022] GET /compute/v2.1/servers/cc0c06a0-156a-4cee-8ff7-92ab582bc4a1 => generated 1523 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:00:11.745987 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-0886ff87-adf5-40ae-b3c8-3ce4371cb2f5 req-40cd62d3-4604-4dd0-8179-264c3040b742 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b4b194e-e03a-474d-8f65-701f6622fdb0", "name": "network-vif-deleted", "tag": "8504d07b-9873-461b-a383-5d5c53437dee"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:00:11.757707 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-0886ff87-adf5-40ae-b3c8-3ce4371cb2f5 req-40cd62d3-4604-4dd0-8179-264c3040b742 service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:11.758159 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-0886ff87-adf5-40ae-b3c8-3ce4371cb2f5 req-40cd62d3-4604-4dd0-8179-264c3040b742 service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:11.777332 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-0886ff87-adf5-40ae-b3c8-3ce4371cb2f5 req-40cd62d3-4604-4dd0-8179-264c3040b742 service nova] Creating event network-vif-deleted:8504d07b-9873-461b-a383-5d5c53437dee for instance 1b4b194e-e03a-474d-8f65-701f6622fdb0 on hv-cinder-85127 Jul 30 05:00:11.782910 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-0886ff87-adf5-40ae-b3c8-3ce4371cb2f5 req-40cd62d3-4604-4dd0-8179-264c3040b742 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042076 Jul 30 05:00:11.783386 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 132/280] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Jul 30 05:00:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 05:00:11.810593 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-dc5c80a2-9a40-43bf-a526-3c4c44a4f855 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:11.811677 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-dc5c80a2-9a40-43bf-a526-3c4c44a4f855 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] [instance: 1b4b194e-e03a-474d-8f65-701f6622fdb0] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:11.822721 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-dc5c80a2-9a40-43bf-a526-3c4c44a4f855 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:11.823872 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-dc5c80a2-9a40-43bf-a526-3c4c44a4f855 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:11.824882 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-dc5c80a2-9a40-43bf-a526-3c4c44a4f855 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:11.825593 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-dc5c80a2-9a40-43bf-a526-3c4c44a4f855 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:11.865297 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-dc5c80a2-9a40-43bf-a526-3c4c44a4f855 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:11.865753 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-dc5c80a2-9a40-43bf-a526-3c4c44a4f855 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:11.866927 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.objects.instance [None req-dc5c80a2-9a40-43bf-a526-3c4c44a4f855 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] Lazy-loading 'fault' on Instance uuid 1b4b194e-e03a-474d-8f65-701f6622fdb0 {{(pid=117885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 05:00:11.931919 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-dc5c80a2-9a40-43bf-a526-3c4c44a4f855 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929d7587f49445ed9c86d53a1d888648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc01f77fe9745369cef62c8379f9209', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:11.937898 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-738242c4-eebf-4df4-9fc8-5fb4fe93008a tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a98edf8e5a4a22b3ae7d041b582b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76df23454a3c4a9bb4f61b044ed5a426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:11.941691 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-dc5c80a2-9a40-43bf-a526-3c4c44a4f855 tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] 10.222.0.20 "GET /compute/v2.1/servers/1b4b194e-e03a-474d-8f65-701f6622fdb0" status: 200 len: 1305 microversion: 2.1 time: 0.157031 Jul 30 05:00:11.942275 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 133/281] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:11 2022] GET /compute/v2.1/servers/1b4b194e-e03a-474d-8f65-701f6622fdb0 => generated 1305 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:00:11.954848 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:00:11.954848 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-738242c4-eebf-4df4-9fc8-5fb4fe93008a tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] 10.222.0.20 "GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f" status: 200 len: 1257 microversion: 2.1 time: 0.527873 Jul 30 05:00:11.954848 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 149/282] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:11 2022] GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f => generated 1257 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:00:12.461484 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-35afb466-bb9e-45ce-b698-474c5e5e8d5f req-77ab60f6-db94-4d92-aa87-0053e422c91b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99b497c8-e641-428a-94b6-86c21af5844f", "tag": "1a76ab0f-eada-4891-8b4c-b2af44036eb1"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:00:12.467490 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:00:12.476166 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-35afb466-bb9e-45ce-b698-474c5e5e8d5f req-77ab60f6-db94-4d92-aa87-0053e422c91b service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:12.476574 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-35afb466-bb9e-45ce-b698-474c5e5e8d5f req-77ab60f6-db94-4d92-aa87-0053e422c91b service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:12.481271 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:00:12.491344 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-35afb466-bb9e-45ce-b698-474c5e5e8d5f req-77ab60f6-db94-4d92-aa87-0053e422c91b service nova] Creating event network-changed:1a76ab0f-eada-4891-8b4c-b2af44036eb1 for instance 99b497c8-e641-428a-94b6-86c21af5844f on hv-cinder-85127 Jul 30 05:00:12.497418 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-35afb466-bb9e-45ce-b698-474c5e5e8d5f req-77ab60f6-db94-4d92-aa87-0053e422c91b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039993 Jul 30 05:00:12.498015 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 134/283] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Jul 30 05:00:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 05:00:12.753412 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-add07c2e-92a2-4ef8-a117-cd4ab12d1d48 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:12.754075 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-add07c2e-92a2-4ef8-a117-cd4ab12d1d48 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: cc0c06a0-156a-4cee-8ff7-92ab582bc4a1] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:12.760719 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-add07c2e-92a2-4ef8-a117-cd4ab12d1d48 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:12.761201 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-add07c2e-92a2-4ef8-a117-cd4ab12d1d48 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:12.766913 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-add07c2e-92a2-4ef8-a117-cd4ab12d1d48 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:12.767370 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-add07c2e-92a2-4ef8-a117-cd4ab12d1d48 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:12.969941 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-1ee6d887-5f08-469a-a98d-c4ec34ee947e tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:12.970699 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-1ee6d887-5f08-469a-a98d-c4ec34ee947e tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] [instance: 99b497c8-e641-428a-94b6-86c21af5844f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:12.981857 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1ee6d887-5f08-469a-a98d-c4ec34ee947e tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:12.983051 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1ee6d887-5f08-469a-a98d-c4ec34ee947e tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:12.985102 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1ee6d887-5f08-469a-a98d-c4ec34ee947e tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:12.986096 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1ee6d887-5f08-469a-a98d-c4ec34ee947e tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:13.196334 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-1ee6d887-5f08-469a-a98d-c4ec34ee947e tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a98edf8e5a4a22b3ae7d041b582b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76df23454a3c4a9bb4f61b044ed5a426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:13.204616 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-1ee6d887-5f08-469a-a98d-c4ec34ee947e tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] 10.222.0.20 "GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f" status: 200 len: 1257 microversion: 2.1 time: 0.240141 Jul 30 05:00:13.207370 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 135/284] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:12 2022] GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f => generated 1257 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 05:00:13.222744 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-c298326d-939f-44e3-8ed0-9f1d906f87fb tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:13.223625 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-c298326d-939f-44e3-8ed0-9f1d906f87fb tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] [instance: 1b4b194e-e03a-474d-8f65-701f6622fdb0] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:13.230141 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c298326d-939f-44e3-8ed0-9f1d906f87fb tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:13.231062 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c298326d-939f-44e3-8ed0-9f1d906f87fb tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:13.232026 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c298326d-939f-44e3-8ed0-9f1d906f87fb tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:13.232715 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c298326d-939f-44e3-8ed0-9f1d906f87fb tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:13.248071 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.wsgi [None req-c298326d-939f-44e3-8ed0-9f1d906f87fb tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] HTTP exception thrown: Instance 1b4b194e-e03a-474d-8f65-701f6622fdb0 could not be found. Jul 30 05:00:13.250393 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-c298326d-939f-44e3-8ed0-9f1d906f87fb tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] Request method failure captured: Jul 30 05:00:13.250393 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: request: GET /compute/v2.1/servers/1b4b194e-e03a-474d-8f65-701f6622fdb0 HTTP/1.1 Jul 30 05:00:13.250393 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Accept: application/json Jul 30 05:00:13.250393 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Accept-Encoding: identity Jul 30 05:00:13.250393 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Connection: close Jul 30 05:00:13.250393 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Content-Length: 0 Jul 30 05:00:13.250393 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Content-Type: application/json Jul 30 05:00:13.250393 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Host: 10.222.0.20 Jul 30 05:00:13.250393 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Openstack-System-Scope: None Jul 30 05:00:13.250393 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: User-Agent: python-urllib3/1.26.10 Jul 30 05:00:13.250393 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Auth-Token: gAAAAABi5LrIr_2IoFdV0RmIuia808rMXrVBKgoWx3Ac3raa_uIG91V4gtU4mbX6YH_nzG5_mmkTY4WFSEGcs57-qqWUdAAYLDrMFTMtXXlJXuB5QykCzl_QguU88U6_DNDoqcQlApn-xg2Zl3Hgdl08e-RwmiDLVnVLP-p1wg-kIEZQkVKEss0 Jul 30 05:00:13.250393 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Domain-Id: None Jul 30 05:00:13.250393 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Domain-Name: None Jul 30 05:00:13.250393 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Identity-Status: Confirmed Jul 30 05:00:13.250393 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Is-Admin-Project: True Jul 30 05:00:13.250393 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Domain-Id: default Jul 30 05:00:13.250393 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Domain-Name: Default Jul 30 05:00:13.250393 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Id: 5dc01f77fe9745369cef62c8379f9209 Jul 30 05:00:13.250393 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Name: tempest-VolumesNegativeTest-2129793623 Jul 30 05:00:13.250393 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Role: member,reader Jul 30 05:00:13.250393 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Roles: member,reader Jul 30 05:00:13.251958 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5dc01f77fe9745369cef62c8379f9209"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5dc01f77fe9745369cef62c8379f9209"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5dc01f77fe9745369cef62c8379f9209"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5dc01f77fe9745369cef62c8379f9209"}]}] Jul 30 05:00:13.251958 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Tenant: tempest-VolumesNegativeTest-2129793623 Jul 30 05:00:13.251958 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Tenant-Id: 5dc01f77fe9745369cef62c8379f9209 Jul 30 05:00:13.251958 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Tenant-Name: tempest-VolumesNegativeTest-2129793623 Jul 30 05:00:13.251958 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User: tempest-VolumesNegativeTest-2129793623-project Jul 30 05:00:13.251958 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Domain-Id: default Jul 30 05:00:13.251958 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Domain-Name: Default Jul 30 05:00:13.251958 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Id: 929d7587f49445ed9c86d53a1d888648 Jul 30 05:00:13.251958 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Name: tempest-VolumesNegativeTest-2129793623-project Jul 30 05:00:13.251958 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: method: > Jul 30 05:00:13.251958 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: exception: Instance 1b4b194e-e03a-474d-8f65-701f6622fdb0 could not be found. Jul 30 05:00:13.251958 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: action_args: {'id': '1b4b194e-e03a-474d-8f65-701f6622fdb0'} Jul 30 05:00:13.253323 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 05:00:13.253323 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:00:13.253323 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 05:00:13.253323 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 05:00:13.253323 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 05:00:13.253323 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 05:00:13.253323 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 05:00:13.253323 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 05:00:13.253323 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 05:00:13.253323 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 05:00:13.253323 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b4b194e-e03a-474d-8f65-701f6622fdb0 could not be found. Jul 30 05:00:13.253323 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:00:13.253323 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 05:00:13.253323 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:00:13.253323 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:00:13.253323 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 05:00:13.253323 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 05:00:13.253323 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 05:00:13.253323 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 05:00:13.253323 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 05:00:13.255030 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 05:00:13.255030 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 05:00:13.255030 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 05:00:13.255030 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 05:00:13.255030 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 05:00:13.255030 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 05:00:13.255030 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 05:00:13.255030 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b4b194e-e03a-474d-8f65-701f6622fdb0 could not be found. Jul 30 05:00:13.255030 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:00:13.255030 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 05:00:13.255030 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:00:13.255030 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:00:13.255030 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 05:00:13.255030 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 05:00:13.255030 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 05:00:13.255030 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 05:00:13.255030 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b4b194e-e03a-474d-8f65-701f6622fdb0 could not be found. Jul 30 05:00:13.255030 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:00:13.256735 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-add07c2e-92a2-4ef8-a117-cd4ab12d1d48 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:13.257560 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-c298326d-939f-44e3-8ed0-9f1d906f87fb tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] Returning 404 to user: Instance 1b4b194e-e03a-474d-8f65-701f6622fdb0 could not be found. {{(pid=117885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 05:00:13.258940 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-c298326d-939f-44e3-8ed0-9f1d906f87fb tempest-VolumesNegativeTest-2129793623 tempest-VolumesNegativeTest-2129793623-project] 10.222.0.20 "GET /compute/v2.1/servers/1b4b194e-e03a-474d-8f65-701f6622fdb0" status: 404 len: 111 microversion: 2.1 time: 0.049190 Jul 30 05:00:13.269870 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-add07c2e-92a2-4ef8-a117-cd4ab12d1d48 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0c06a0-156a-4cee-8ff7-92ab582bc4a1" status: 200 len: 1523 microversion: 2.1 time: 0.518235 Jul 30 05:00:13.269870 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 150/285] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:12 2022] GET /compute/v2.1/servers/cc0c06a0-156a-4cee-8ff7-92ab582bc4a1 => generated 1523 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 05:00:13.274208 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 136/286] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:13 2022] GET /compute/v2.1/servers/1b4b194e-e03a-474d-8f65-701f6622fdb0 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 05:00:14.226196 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-58bb1dfd-03c7-4980-9498-84752e5c9ebb tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:14.227860 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-58bb1dfd-03c7-4980-9498-84752e5c9ebb tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] [instance: 99b497c8-e641-428a-94b6-86c21af5844f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:14.235482 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:00:14.245627 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-58bb1dfd-03c7-4980-9498-84752e5c9ebb tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:14.246217 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-58bb1dfd-03c7-4980-9498-84752e5c9ebb tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:14.247060 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-58bb1dfd-03c7-4980-9498-84752e5c9ebb tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:14.247503 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-58bb1dfd-03c7-4980-9498-84752e5c9ebb tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:14.288569 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-95e9f48c-31a7-406c-9dbe-cec1e2eaba1c tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:14.289346 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-95e9f48c-31a7-406c-9dbe-cec1e2eaba1c tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: cc0c06a0-156a-4cee-8ff7-92ab582bc4a1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:14.300027 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-95e9f48c-31a7-406c-9dbe-cec1e2eaba1c tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:14.300755 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-95e9f48c-31a7-406c-9dbe-cec1e2eaba1c tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:14.301784 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-95e9f48c-31a7-406c-9dbe-cec1e2eaba1c tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:14.302384 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-95e9f48c-31a7-406c-9dbe-cec1e2eaba1c tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:14.475217 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-58bb1dfd-03c7-4980-9498-84752e5c9ebb tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a98edf8e5a4a22b3ae7d041b582b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76df23454a3c4a9bb4f61b044ed5a426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:14.484498 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-58bb1dfd-03c7-4980-9498-84752e5c9ebb tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] 10.222.0.20 "GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f" status: 200 len: 1257 microversion: 2.1 time: 0.262267 Jul 30 05:00:14.485721 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 151/287] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:14 2022] GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f => generated 1257 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:00:14.563250 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-95e9f48c-31a7-406c-9dbe-cec1e2eaba1c tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:14.571307 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-95e9f48c-31a7-406c-9dbe-cec1e2eaba1c tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0c06a0-156a-4cee-8ff7-92ab582bc4a1" status: 200 len: 1523 microversion: 2.1 time: 0.286778 Jul 30 05:00:14.585805 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 137/288] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:14 2022] GET /compute/v2.1/servers/cc0c06a0-156a-4cee-8ff7-92ab582bc4a1 => generated 1523 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 05:00:15.508171 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-992c5ce1-2d05-47dd-82d3-c3a5e0632c81 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:15.510097 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-992c5ce1-2d05-47dd-82d3-c3a5e0632c81 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] [instance: 99b497c8-e641-428a-94b6-86c21af5844f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:15.518901 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-992c5ce1-2d05-47dd-82d3-c3a5e0632c81 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:15.519669 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-992c5ce1-2d05-47dd-82d3-c3a5e0632c81 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:15.521370 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-992c5ce1-2d05-47dd-82d3-c3a5e0632c81 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:15.521874 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-992c5ce1-2d05-47dd-82d3-c3a5e0632c81 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:15.593794 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-ceb1ded8-b1a1-434a-863e-30ad71a0bda8 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:15.595485 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-ceb1ded8-b1a1-434a-863e-30ad71a0bda8 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: cc0c06a0-156a-4cee-8ff7-92ab582bc4a1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:15.610036 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ceb1ded8-b1a1-434a-863e-30ad71a0bda8 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:15.610849 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ceb1ded8-b1a1-434a-863e-30ad71a0bda8 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:15.612875 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ceb1ded8-b1a1-434a-863e-30ad71a0bda8 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:15.613558 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ceb1ded8-b1a1-434a-863e-30ad71a0bda8 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:15.703520 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-992c5ce1-2d05-47dd-82d3-c3a5e0632c81 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a98edf8e5a4a22b3ae7d041b582b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76df23454a3c4a9bb4f61b044ed5a426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:15.724001 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-992c5ce1-2d05-47dd-82d3-c3a5e0632c81 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] 10.222.0.20 "GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f" status: 200 len: 1257 microversion: 2.1 time: 0.221538 Jul 30 05:00:15.725226 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 152/289] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:15 2022] GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f => generated 1257 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:00:15.781811 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-ceb1ded8-b1a1-434a-863e-30ad71a0bda8 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:15.793545 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-ceb1ded8-b1a1-434a-863e-30ad71a0bda8 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0c06a0-156a-4cee-8ff7-92ab582bc4a1" status: 200 len: 1523 microversion: 2.1 time: 0.204171 Jul 30 05:00:15.794225 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 138/290] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:15 2022] GET /compute/v2.1/servers/cc0c06a0-156a-4cee-8ff7-92ab582bc4a1 => generated 1523 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 05:00:16.745476 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-90f0af7b-277f-48af-9096-7e1b7237cb02 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:16.746085 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-90f0af7b-277f-48af-9096-7e1b7237cb02 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] [instance: 99b497c8-e641-428a-94b6-86c21af5844f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:16.752756 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-90f0af7b-277f-48af-9096-7e1b7237cb02 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:16.753210 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-90f0af7b-277f-48af-9096-7e1b7237cb02 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:16.754274 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-90f0af7b-277f-48af-9096-7e1b7237cb02 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:16.754827 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-90f0af7b-277f-48af-9096-7e1b7237cb02 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:16.817527 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-63bd1704-de03-4430-8e45-6b3d37ca30d8 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:16.819344 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-63bd1704-de03-4430-8e45-6b3d37ca30d8 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: cc0c06a0-156a-4cee-8ff7-92ab582bc4a1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:16.828108 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-63bd1704-de03-4430-8e45-6b3d37ca30d8 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:16.828685 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-63bd1704-de03-4430-8e45-6b3d37ca30d8 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:16.829468 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-63bd1704-de03-4430-8e45-6b3d37ca30d8 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:16.829913 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-63bd1704-de03-4430-8e45-6b3d37ca30d8 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:17.038740 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-90f0af7b-277f-48af-9096-7e1b7237cb02 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a98edf8e5a4a22b3ae7d041b582b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76df23454a3c4a9bb4f61b044ed5a426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:17.044070 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-63bd1704-de03-4430-8e45-6b3d37ca30d8 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:17.060968 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-63bd1704-de03-4430-8e45-6b3d37ca30d8 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0c06a0-156a-4cee-8ff7-92ab582bc4a1" status: 200 len: 1523 microversion: 2.1 time: 0.249499 Jul 30 05:00:17.061502 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-90f0af7b-277f-48af-9096-7e1b7237cb02 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] 10.222.0.20 "GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f" status: 200 len: 1257 microversion: 2.1 time: 0.317983 Jul 30 05:00:17.062098 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 153/291] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:16 2022] GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f => generated 1257 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:00:17.062852 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 139/292] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:16 2022] GET /compute/v2.1/servers/cc0c06a0-156a-4cee-8ff7-92ab582bc4a1 => generated 1523 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:00:18.084401 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-bfad25cd-8b2c-42ad-91f3-6f664c1f0424 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:18.085037 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-d9661efd-e3ba-48b5-9c7d-83a11d706c98 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:18.085387 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-bfad25cd-8b2c-42ad-91f3-6f664c1f0424 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: cc0c06a0-156a-4cee-8ff7-92ab582bc4a1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:18.086152 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-d9661efd-e3ba-48b5-9c7d-83a11d706c98 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] [instance: 99b497c8-e641-428a-94b6-86c21af5844f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:18.088523 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell0:SELECT=2 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:00:18.089547 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell0:SELECT=6 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:00:18.090596 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell0:SELECT=2 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:00:18.094547 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-bfad25cd-8b2c-42ad-91f3-6f664c1f0424 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:18.095135 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-bfad25cd-8b2c-42ad-91f3-6f664c1f0424 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:18.096058 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-bfad25cd-8b2c-42ad-91f3-6f664c1f0424 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:18.097140 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-bfad25cd-8b2c-42ad-91f3-6f664c1f0424 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:18.098152 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d9661efd-e3ba-48b5-9c7d-83a11d706c98 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:18.098763 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d9661efd-e3ba-48b5-9c7d-83a11d706c98 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:18.099554 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d9661efd-e3ba-48b5-9c7d-83a11d706c98 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:18.100123 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d9661efd-e3ba-48b5-9c7d-83a11d706c98 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:18.250770 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-bfad25cd-8b2c-42ad-91f3-6f664c1f0424 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:18.257336 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-d9661efd-e3ba-48b5-9c7d-83a11d706c98 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a98edf8e5a4a22b3ae7d041b582b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76df23454a3c4a9bb4f61b044ed5a426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:18.260962 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-bfad25cd-8b2c-42ad-91f3-6f664c1f0424 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0c06a0-156a-4cee-8ff7-92ab582bc4a1" status: 200 len: 1523 microversion: 2.1 time: 0.180886 Jul 30 05:00:18.261870 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 140/293] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:18 2022] GET /compute/v2.1/servers/cc0c06a0-156a-4cee-8ff7-92ab582bc4a1 => generated 1523 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:00:18.266402 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-d9661efd-e3ba-48b5-9c7d-83a11d706c98 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] 10.222.0.20 "GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f" status: 200 len: 1257 microversion: 2.1 time: 0.186377 Jul 30 05:00:18.267267 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 154/294] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:18 2022] GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f => generated 1257 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:00:19.284189 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-63ba6f2b-4f06-48f1-9897-ccdde5c7814e tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:19.284819 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-63ba6f2b-4f06-48f1-9897-ccdde5c7814e tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: cc0c06a0-156a-4cee-8ff7-92ab582bc4a1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:19.291787 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-63ba6f2b-4f06-48f1-9897-ccdde5c7814e tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:19.292506 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-63ba6f2b-4f06-48f1-9897-ccdde5c7814e tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:19.293711 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-63ba6f2b-4f06-48f1-9897-ccdde5c7814e tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:19.294092 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-7c4a8501-8330-4002-b4ad-82c9ce373745 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:19.294868 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-7c4a8501-8330-4002-b4ad-82c9ce373745 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] [instance: 99b497c8-e641-428a-94b6-86c21af5844f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:19.295246 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-63ba6f2b-4f06-48f1-9897-ccdde5c7814e tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:19.305367 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7c4a8501-8330-4002-b4ad-82c9ce373745 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:19.306072 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7c4a8501-8330-4002-b4ad-82c9ce373745 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:19.307535 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7c4a8501-8330-4002-b4ad-82c9ce373745 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:19.308064 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7c4a8501-8330-4002-b4ad-82c9ce373745 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:19.503983 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-63ba6f2b-4f06-48f1-9897-ccdde5c7814e tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:19.513364 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-63ba6f2b-4f06-48f1-9897-ccdde5c7814e tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0c06a0-156a-4cee-8ff7-92ab582bc4a1" status: 200 len: 1523 microversion: 2.1 time: 0.233238 Jul 30 05:00:19.514185 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 141/295] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:19 2022] GET /compute/v2.1/servers/cc0c06a0-156a-4cee-8ff7-92ab582bc4a1 => generated 1523 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 05:00:19.616847 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-7c4a8501-8330-4002-b4ad-82c9ce373745 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a98edf8e5a4a22b3ae7d041b582b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76df23454a3c4a9bb4f61b044ed5a426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:19.630108 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-7c4a8501-8330-4002-b4ad-82c9ce373745 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] 10.222.0.20 "GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f" status: 200 len: 1257 microversion: 2.1 time: 0.341935 Jul 30 05:00:19.630742 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 155/296] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:19 2022] GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f => generated 1257 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:00:20.535928 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-5eba9e8a-ff58-4c47-ac11-d4be8579271b tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:20.536681 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-5eba9e8a-ff58-4c47-ac11-d4be8579271b tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: cc0c06a0-156a-4cee-8ff7-92ab582bc4a1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:20.543409 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5eba9e8a-ff58-4c47-ac11-d4be8579271b tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:20.544146 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5eba9e8a-ff58-4c47-ac11-d4be8579271b tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:20.544978 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5eba9e8a-ff58-4c47-ac11-d4be8579271b tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:20.545484 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5eba9e8a-ff58-4c47-ac11-d4be8579271b tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:20.651291 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-cf9fca9d-a825-4727-8cc2-2ad6cea05573 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:20.651948 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-cf9fca9d-a825-4727-8cc2-2ad6cea05573 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] [instance: 99b497c8-e641-428a-94b6-86c21af5844f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:20.662483 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cf9fca9d-a825-4727-8cc2-2ad6cea05573 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:20.663293 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cf9fca9d-a825-4727-8cc2-2ad6cea05573 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:20.664237 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cf9fca9d-a825-4727-8cc2-2ad6cea05573 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:20.664939 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cf9fca9d-a825-4727-8cc2-2ad6cea05573 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:20.880439 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-cf9fca9d-a825-4727-8cc2-2ad6cea05573 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a98edf8e5a4a22b3ae7d041b582b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76df23454a3c4a9bb4f61b044ed5a426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:20.887243 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-5eba9e8a-ff58-4c47-ac11-d4be8579271b tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:20.889647 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-cf9fca9d-a825-4727-8cc2-2ad6cea05573 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] 10.222.0.20 "GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f" status: 200 len: 1257 microversion: 2.1 time: 0.242391 Jul 30 05:00:20.891390 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 156/297] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:20 2022] GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f => generated 1257 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 05:00:20.902013 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-5eba9e8a-ff58-4c47-ac11-d4be8579271b tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0c06a0-156a-4cee-8ff7-92ab582bc4a1" status: 200 len: 1523 microversion: 2.1 time: 0.370364 Jul 30 05:00:20.902980 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 142/298] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:20 2022] GET /compute/v2.1/servers/cc0c06a0-156a-4cee-8ff7-92ab582bc4a1 => generated 1523 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:00:21.912194 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-4a61a3d2-e686-4db4-b659-762c6abba45c tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:21.913328 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-4a61a3d2-e686-4db4-b659-762c6abba45c tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] [instance: 99b497c8-e641-428a-94b6-86c21af5844f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:21.921614 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4a61a3d2-e686-4db4-b659-762c6abba45c tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:21.922044 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4a61a3d2-e686-4db4-b659-762c6abba45c tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:21.922840 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4a61a3d2-e686-4db4-b659-762c6abba45c tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:21.923815 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4a61a3d2-e686-4db4-b659-762c6abba45c tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:21.931641 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-c05cc50c-cf9e-4116-b571-adad9280a4f9 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:21.932346 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-c05cc50c-cf9e-4116-b571-adad9280a4f9 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: cc0c06a0-156a-4cee-8ff7-92ab582bc4a1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:21.942181 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c05cc50c-cf9e-4116-b571-adad9280a4f9 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:21.942855 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c05cc50c-cf9e-4116-b571-adad9280a4f9 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:21.944581 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c05cc50c-cf9e-4116-b571-adad9280a4f9 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:21.945385 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c05cc50c-cf9e-4116-b571-adad9280a4f9 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:22.137955 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-4a61a3d2-e686-4db4-b659-762c6abba45c tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a98edf8e5a4a22b3ae7d041b582b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76df23454a3c4a9bb4f61b044ed5a426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:22.152754 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-4a61a3d2-e686-4db4-b659-762c6abba45c tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] 10.222.0.20 "GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f" status: 200 len: 1257 microversion: 2.1 time: 0.244844 Jul 30 05:00:22.153526 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 157/299] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:21 2022] GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f => generated 1257 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:00:22.200322 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-c05cc50c-cf9e-4116-b571-adad9280a4f9 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:22.214156 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-c05cc50c-cf9e-4116-b571-adad9280a4f9 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0c06a0-156a-4cee-8ff7-92ab582bc4a1" status: 200 len: 1523 microversion: 2.1 time: 0.285586 Jul 30 05:00:22.215087 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 143/300] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:21 2022] GET /compute/v2.1/servers/cc0c06a0-156a-4cee-8ff7-92ab582bc4a1 => generated 1523 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 05:00:22.324530 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-b2877a71-8e83-4828-8cbf-e229f63d3be3 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:22.325055 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-b2877a71-8e83-4828-8cbf-e229f63d3be3 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: f27c16ec-7d74-4a2a-9b40-c95455fa8aff] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:22.335337 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b2877a71-8e83-4828-8cbf-e229f63d3be3 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:22.336106 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b2877a71-8e83-4828-8cbf-e229f63d3be3 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:22.337059 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b2877a71-8e83-4828-8cbf-e229f63d3be3 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:22.337742 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b2877a71-8e83-4828-8cbf-e229f63d3be3 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:22.365552 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-b2877a71-8e83-4828-8cbf-e229f63d3be3 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff/ips" status: 200 len: 149 microversion: 2.1 time: 0.045407 Jul 30 05:00:22.366117 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 158/301] 10.222.0.20 () {58 vars in 1248 bytes} [Sat Jul 30 05:00:22 2022] GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff/ips => generated 149 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 05:00:23.180218 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-4bb1948d-0227-472b-aa91-74bbdf2a6aab tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:23.181503 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-4bb1948d-0227-472b-aa91-74bbdf2a6aab tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] [instance: 99b497c8-e641-428a-94b6-86c21af5844f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:23.188271 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4bb1948d-0227-472b-aa91-74bbdf2a6aab tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:23.188959 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4bb1948d-0227-472b-aa91-74bbdf2a6aab tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:23.189902 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4bb1948d-0227-472b-aa91-74bbdf2a6aab tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:23.191742 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4bb1948d-0227-472b-aa91-74bbdf2a6aab tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:23.240859 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-aa209445-b3e1-443d-a198-010c04f7de5e tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:23.241485 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-aa209445-b3e1-443d-a198-010c04f7de5e tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: cc0c06a0-156a-4cee-8ff7-92ab582bc4a1] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:23.253355 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-aa209445-b3e1-443d-a198-010c04f7de5e tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:23.254018 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-aa209445-b3e1-443d-a198-010c04f7de5e tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:23.256233 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-aa209445-b3e1-443d-a198-010c04f7de5e tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:23.256233 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-aa209445-b3e1-443d-a198-010c04f7de5e tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:23.396347 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-4bb1948d-0227-472b-aa91-74bbdf2a6aab tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a98edf8e5a4a22b3ae7d041b582b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76df23454a3c4a9bb4f61b044ed5a426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:23.404933 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-4bb1948d-0227-472b-aa91-74bbdf2a6aab tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] 10.222.0.20 "GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f" status: 200 len: 1257 microversion: 2.1 time: 0.228818 Jul 30 05:00:23.405718 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 144/302] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:23 2022] GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f => generated 1257 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:00:23.462702 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-aa209445-b3e1-443d-a198-010c04f7de5e tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:23.469959 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-aa209445-b3e1-443d-a198-010c04f7de5e tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0c06a0-156a-4cee-8ff7-92ab582bc4a1" status: 200 len: 1523 microversion: 2.1 time: 0.236108 Jul 30 05:00:23.470539 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 159/303] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:23 2022] GET /compute/v2.1/servers/cc0c06a0-156a-4cee-8ff7-92ab582bc4a1 => generated 1523 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:00:24.001427 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-5a6ba0af-e890-48bb-a1bb-058cdca2555f tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "41a25d81-2695-4312-b74a-a5f51bacc1ea"}} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:00:24.003885 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-5a6ba0af-e890-48bb-a1bb-058cdca2555f tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: f27c16ec-7d74-4a2a-9b40-c95455fa8aff] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:24.009885 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5a6ba0af-e890-48bb-a1bb-058cdca2555f tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:24.010652 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5a6ba0af-e890-48bb-a1bb-058cdca2555f tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:24.011592 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5a6ba0af-e890-48bb-a1bb-058cdca2555f tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:24.012198 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5a6ba0af-e890-48bb-a1bb-058cdca2555f tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:24.180752 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-d5bd9689-1969-4cd6-ac93-e7887de3296b tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-907825989", "imageRef": "d6a9c8e1-ecb9-4603-bb88-2b0d46ac2387", "flavorRef": "452", "networks": [{"uuid": "42292243-279e-4264-96e0-23f67ff78d87"}]}} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:00:24.239318 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.network.neutron [None req-d5bd9689-1969-4cd6-ac93-e7887de3296b tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] validate_networks() for [('42292243-279e-4264-96e0-23f67ff78d87', None, None, None, None, None)] {{(pid=117886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 05:00:24.640900 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-d5bd9689-1969-4cd6-ac93-e7887de3296b tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Flavor limits 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 05:00:24.641527 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-d5bd9689-1969-4cd6-ac93-e7887de3296b tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Image limits 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 05:00:24.641835 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-d5bd9689-1969-4cd6-ac93-e7887de3296b tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Flavor pref 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 05:00:24.642475 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-d5bd9689-1969-4cd6-ac93-e7887de3296b tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Image pref 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 05:00:24.643080 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-d5bd9689-1969-4cd6-ac93-e7887de3296b tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 05:00:24.653275 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d5bd9689-1969-4cd6-ac93-e7887de3296b tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:24.653778 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d5bd9689-1969-4cd6-ac93-e7887de3296b tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:24.654619 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d5bd9689-1969-4cd6-ac93-e7887de3296b tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:24.655369 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d5bd9689-1969-4cd6-ac93-e7887de3296b tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:24.675710 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.quota [None req-d5bd9689-1969-4cd6-ac93-e7887de3296b tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Getting quotas for project a6a02f6df4ed4365b3ce1fa970f9cf41. Resources: {'ram', 'cores', 'instances'} {{(pid=117886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 05:00:24.681331 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.quota [None req-d5bd9689-1969-4cd6-ac93-e7887de3296b tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Getting quotas for user 334f2d8d9d9a4f7a90586999398f8a40 and project a6a02f6df4ed4365b3ce1fa970f9cf41. Resources: {'ram', 'cores', 'instances'} {{(pid=117886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 05:00:24.696335 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-d5bd9689-1969-4cd6-ac93-e7887de3296b tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Going to run 1 instances... {{(pid=117886) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 05:00:24.699212 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-d5bd9689-1969-4cd6-ac93-e7887de3296b tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] [instance: fdf672c0-82ac-413b-a8cc-e01a4de45c4e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d6a9c8e1-ecb9-4603-bb88-2b0d46ac2387',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 05:00:24.746173 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-d5bd9689-1969-4cd6-ac93-e7887de3296b tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.569293 Jul 30 05:00:24.747303 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 160/304] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Jul 30 05:00:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 571 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 05:00:24.756619 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-87a6806f-2c4e-4015-b29b-7e4c4f5ddd98 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:24.757399 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-87a6806f-2c4e-4015-b29b-7e4c4f5ddd98 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] [instance: 99b497c8-e641-428a-94b6-86c21af5844f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:24.766121 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-87a6806f-2c4e-4015-b29b-7e4c4f5ddd98 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:24.766121 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-87a6806f-2c4e-4015-b29b-7e4c4f5ddd98 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:24.766795 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-87a6806f-2c4e-4015-b29b-7e4c4f5ddd98 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:24.767481 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-87a6806f-2c4e-4015-b29b-7e4c4f5ddd98 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:25.119759 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-87a6806f-2c4e-4015-b29b-7e4c4f5ddd98 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a98edf8e5a4a22b3ae7d041b582b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76df23454a3c4a9bb4f61b044ed5a426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:25.128266 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-87a6806f-2c4e-4015-b29b-7e4c4f5ddd98 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] 10.222.0.20 "GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f" status: 200 len: 1257 microversion: 2.1 time: 0.379806 Jul 30 05:00:25.129523 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 161/305] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:24 2022] GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f => generated 1257 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:00:25.134673 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-38b79552-6096-47c5-a2b0-d5fcdc99fb07 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:25.135533 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-38b79552-6096-47c5-a2b0-d5fcdc99fb07 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: cc0c06a0-156a-4cee-8ff7-92ab582bc4a1] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:25.142683 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-38b79552-6096-47c5-a2b0-d5fcdc99fb07 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:25.143559 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-38b79552-6096-47c5-a2b0-d5fcdc99fb07 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:25.144949 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-38b79552-6096-47c5-a2b0-d5fcdc99fb07 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:25.145365 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-38b79552-6096-47c5-a2b0-d5fcdc99fb07 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:25.305678 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-38b79552-6096-47c5-a2b0-d5fcdc99fb07 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:25.313909 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-38b79552-6096-47c5-a2b0-d5fcdc99fb07 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0c06a0-156a-4cee-8ff7-92ab582bc4a1" status: 200 len: 1523 microversion: 2.1 time: 0.183077 Jul 30 05:00:25.314613 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 162/306] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:25 2022] GET /compute/v2.1/servers/cc0c06a0-156a-4cee-8ff7-92ab582bc4a1 => generated 1523 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:00:25.331222 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-af3183a8-0460-4d46-88b9-d03548e0ce3a tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:25.332022 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-af3183a8-0460-4d46-88b9-d03548e0ce3a tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] [instance: fdf672c0-82ac-413b-a8cc-e01a4de45c4e] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:25.338000 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-af3183a8-0460-4d46-88b9-d03548e0ce3a tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:25.338561 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-af3183a8-0460-4d46-88b9-d03548e0ce3a tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:25.339387 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-af3183a8-0460-4d46-88b9-d03548e0ce3a tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:25.339908 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-af3183a8-0460-4d46-88b9-d03548e0ce3a tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:25.406647 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-af3183a8-0460-4d46-88b9-d03548e0ce3a tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334f2d8d9d9a4f7a90586999398f8a40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a02f6df4ed4365b3ce1fa970f9cf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:25.415124 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-af3183a8-0460-4d46-88b9-d03548e0ce3a tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] 10.222.0.20 "GET /compute/v2.1/servers/fdf672c0-82ac-413b-a8cc-e01a4de45c4e" status: 200 len: 1222 microversion: 2.1 time: 0.098397 Jul 30 05:00:25.415487 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 163/307] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:25 2022] GET /compute/v2.1/servers/fdf672c0-82ac-413b-a8cc-e01a4de45c4e => generated 1222 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:00:25.420294 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-39278ceb-b521-462a-87ce-70c3e64835e8 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:25.420790 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-39278ceb-b521-462a-87ce-70c3e64835e8 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:25.430032 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-39278ceb-b521-462a-87ce-70c3e64835e8 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:25.430510 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-39278ceb-b521-462a-87ce-70c3e64835e8 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:25.431298 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-39278ceb-b521-462a-87ce-70c3e64835e8 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:25.431733 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-39278ceb-b521-462a-87ce-70c3e64835e8 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:25.460998 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-39278ceb-b521-462a-87ce-70c3e64835e8 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229/ips" status: 200 len: 151 microversion: 2.20 time: 0.044338 Jul 30 05:00:25.461530 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 164/308] 10.222.0.20 () {60 vars in 1289 bytes} [Sat Jul 30 05:00:25 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229/ips => generated 151 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 05:00:26.150791 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-c75b7766-8368-444f-a637-8baef6c6c28e tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:26.151375 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-c75b7766-8368-444f-a637-8baef6c6c28e tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] [instance: 99b497c8-e641-428a-94b6-86c21af5844f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:26.157246 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c75b7766-8368-444f-a637-8baef6c6c28e tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:26.157698 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c75b7766-8368-444f-a637-8baef6c6c28e tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:26.158480 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c75b7766-8368-444f-a637-8baef6c6c28e tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:26.158930 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c75b7766-8368-444f-a637-8baef6c6c28e tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:26.291030 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-c75b7766-8368-444f-a637-8baef6c6c28e tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a98edf8e5a4a22b3ae7d041b582b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76df23454a3c4a9bb4f61b044ed5a426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:26.298566 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-c75b7766-8368-444f-a637-8baef6c6c28e tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] 10.222.0.20 "GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f" status: 200 len: 1257 microversion: 2.1 time: 0.151782 Jul 30 05:00:26.313126 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 165/309] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:26 2022] GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f => generated 1257 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 05:00:26.335549 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-98cb0ce0-8e7e-4244-b92a-1fe58ee6921f tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:26.336255 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-98cb0ce0-8e7e-4244-b92a-1fe58ee6921f tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: cc0c06a0-156a-4cee-8ff7-92ab582bc4a1] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:26.342081 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-98cb0ce0-8e7e-4244-b92a-1fe58ee6921f tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:26.342555 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-98cb0ce0-8e7e-4244-b92a-1fe58ee6921f tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:26.343305 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-98cb0ce0-8e7e-4244-b92a-1fe58ee6921f tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:26.343735 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-98cb0ce0-8e7e-4244-b92a-1fe58ee6921f tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:26.484132 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-98cb0ce0-8e7e-4244-b92a-1fe58ee6921f tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:26.491684 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-98cb0ce0-8e7e-4244-b92a-1fe58ee6921f tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0c06a0-156a-4cee-8ff7-92ab582bc4a1" status: 200 len: 1523 microversion: 2.1 time: 0.159929 Jul 30 05:00:26.492272 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 166/310] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:26 2022] GET /compute/v2.1/servers/cc0c06a0-156a-4cee-8ff7-92ab582bc4a1 => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 05:00:26.496673 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-72116b6c-923a-41da-ad03-ac1ce740c282 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:26.497265 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-72116b6c-923a-41da-ad03-ac1ce740c282 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] [instance: fdf672c0-82ac-413b-a8cc-e01a4de45c4e] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:26.503636 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-72116b6c-923a-41da-ad03-ac1ce740c282 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:26.504179 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-72116b6c-923a-41da-ad03-ac1ce740c282 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:26.504934 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-72116b6c-923a-41da-ad03-ac1ce740c282 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:26.505365 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-72116b6c-923a-41da-ad03-ac1ce740c282 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:26.573792 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-72116b6c-923a-41da-ad03-ac1ce740c282 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334f2d8d9d9a4f7a90586999398f8a40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a02f6df4ed4365b3ce1fa970f9cf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:26.577181 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=100 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:00:26.582527 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-72116b6c-923a-41da-ad03-ac1ce740c282 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] 10.222.0.20 "GET /compute/v2.1/servers/fdf672c0-82ac-413b-a8cc-e01a4de45c4e" status: 200 len: 1222 microversion: 2.1 time: 0.089284 Jul 30 05:00:26.583088 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 167/311] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:26 2022] GET /compute/v2.1/servers/fdf672c0-82ac-413b-a8cc-e01a4de45c4e => generated 1222 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:00:26.766353 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-5a6ba0af-e890-48bb-a1bb-058cdca2555f tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "POST /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.764153 Jul 30 05:00:26.767695 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 145/312] 10.222.0.20 () {60 vars in 1323 bytes} [Sat Jul 30 05:00:23 2022] POST /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff/os-volume_attachments => generated 194 bytes in 2771 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 05:00:27.016938 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-580dcdbf-8a46-4b73-ac33-44f85ea7f208 req-f52a72ab-7eda-40e5-bc68-8c35928e6378 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99b497c8-e641-428a-94b6-86c21af5844f", "name": "network-vif-plugged", "status": "completed", "tag": "1a76ab0f-eada-4891-8b4c-b2af44036eb1"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:00:27.028503 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-580dcdbf-8a46-4b73-ac33-44f85ea7f208 req-f52a72ab-7eda-40e5-bc68-8c35928e6378 service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:27.029128 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-580dcdbf-8a46-4b73-ac33-44f85ea7f208 req-f52a72ab-7eda-40e5-bc68-8c35928e6378 service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:27.043977 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-580dcdbf-8a46-4b73-ac33-44f85ea7f208 req-f52a72ab-7eda-40e5-bc68-8c35928e6378 service nova] Creating event network-vif-plugged:1a76ab0f-eada-4891-8b4c-b2af44036eb1 for instance 99b497c8-e641-428a-94b6-86c21af5844f on hv-cinder-85127 Jul 30 05:00:27.050218 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-580dcdbf-8a46-4b73-ac33-44f85ea7f208 req-f52a72ab-7eda-40e5-bc68-8c35928e6378 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036296 Jul 30 05:00:27.050648 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 168/313] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Jul 30 05:00:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 05:00:27.320963 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-5e07a4ea-6e47-4a6f-954f-1f1f0e8048b8 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:27.321670 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-5e07a4ea-6e47-4a6f-954f-1f1f0e8048b8 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] [instance: 99b497c8-e641-428a-94b6-86c21af5844f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:27.328100 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5e07a4ea-6e47-4a6f-954f-1f1f0e8048b8 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:27.328555 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5e07a4ea-6e47-4a6f-954f-1f1f0e8048b8 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:27.329322 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5e07a4ea-6e47-4a6f-954f-1f1f0e8048b8 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:27.329787 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5e07a4ea-6e47-4a6f-954f-1f1f0e8048b8 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:27.465242 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-5e07a4ea-6e47-4a6f-954f-1f1f0e8048b8 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a98edf8e5a4a22b3ae7d041b582b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76df23454a3c4a9bb4f61b044ed5a426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:27.473164 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-5e07a4ea-6e47-4a6f-954f-1f1f0e8048b8 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] 10.222.0.20 "GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f" status: 200 len: 1257 microversion: 2.1 time: 0.156854 Jul 30 05:00:27.473729 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 146/314] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:27 2022] GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f => generated 1257 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:00:27.515087 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-8f6bbdc6-759b-4747-af03-c6143e75bcc8 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:27.516804 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-8f6bbdc6-759b-4747-af03-c6143e75bcc8 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: cc0c06a0-156a-4cee-8ff7-92ab582bc4a1] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:27.528317 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8f6bbdc6-759b-4747-af03-c6143e75bcc8 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:27.528783 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8f6bbdc6-759b-4747-af03-c6143e75bcc8 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:27.529601 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8f6bbdc6-759b-4747-af03-c6143e75bcc8 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:27.530046 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8f6bbdc6-759b-4747-af03-c6143e75bcc8 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:27.607189 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-a63a6e07-708e-4e5c-924e-d69e677b8f26 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:27.608249 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-a63a6e07-708e-4e5c-924e-d69e677b8f26 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] [instance: fdf672c0-82ac-413b-a8cc-e01a4de45c4e] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:27.616517 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a63a6e07-708e-4e5c-924e-d69e677b8f26 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:27.616976 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a63a6e07-708e-4e5c-924e-d69e677b8f26 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:27.618162 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a63a6e07-708e-4e5c-924e-d69e677b8f26 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:27.618295 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a63a6e07-708e-4e5c-924e-d69e677b8f26 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:27.690390 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-8f6bbdc6-759b-4747-af03-c6143e75bcc8 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:27.697275 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-a63a6e07-708e-4e5c-924e-d69e677b8f26 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334f2d8d9d9a4f7a90586999398f8a40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a02f6df4ed4365b3ce1fa970f9cf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:27.699046 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-8f6bbdc6-759b-4747-af03-c6143e75bcc8 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0c06a0-156a-4cee-8ff7-92ab582bc4a1" status: 200 len: 1523 microversion: 2.1 time: 0.188999 Jul 30 05:00:27.699738 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 169/315] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:27 2022] GET /compute/v2.1/servers/cc0c06a0-156a-4cee-8ff7-92ab582bc4a1 => generated 1523 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:00:27.707965 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-a63a6e07-708e-4e5c-924e-d69e677b8f26 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] 10.222.0.20 "GET /compute/v2.1/servers/fdf672c0-82ac-413b-a8cc-e01a4de45c4e" status: 200 len: 1270 microversion: 2.1 time: 0.106422 Jul 30 05:00:27.708697 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 147/316] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:27 2022] GET /compute/v2.1/servers/fdf672c0-82ac-413b-a8cc-e01a4de45c4e => generated 1270 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 05:00:28.493870 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-ab0387b8-b0e2-4145-889c-b582a0635791 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:28.494506 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-ab0387b8-b0e2-4145-889c-b582a0635791 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] [instance: 99b497c8-e641-428a-94b6-86c21af5844f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:28.500599 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ab0387b8-b0e2-4145-889c-b582a0635791 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:28.501045 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ab0387b8-b0e2-4145-889c-b582a0635791 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:28.501866 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ab0387b8-b0e2-4145-889c-b582a0635791 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:28.502299 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ab0387b8-b0e2-4145-889c-b582a0635791 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:28.584331 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-719ccafd-a733-4e08-b1de-313ba648dbe7 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:00:28.584948 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-719ccafd-a733-4e08-b1de-313ba648dbe7 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:28.591933 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-719ccafd-a733-4e08-b1de-313ba648dbe7 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:28.592484 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-719ccafd-a733-4e08-b1de-313ba648dbe7 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:28.593339 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-719ccafd-a733-4e08-b1de-313ba648dbe7 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:28.593781 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-719ccafd-a733-4e08-b1de-313ba648dbe7 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:28.618922 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.objects.instance [None req-719ccafd-a733-4e08-b1de-313ba648dbe7 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lazy-loading 'flavor' on Instance uuid e4370e65-bec4-454f-9566-33ff60441229 {{(pid=117885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 05:00:28.647172 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-ab0387b8-b0e2-4145-889c-b582a0635791 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a98edf8e5a4a22b3ae7d041b582b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76df23454a3c4a9bb4f61b044ed5a426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:28.655049 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-ab0387b8-b0e2-4145-889c-b582a0635791 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] 10.222.0.20 "GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f" status: 200 len: 1257 microversion: 2.1 time: 0.165148 Jul 30 05:00:28.656538 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 170/317] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:28 2022] GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f => generated 1257 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 05:00:28.723258 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-e6cc6603-47a6-4870-9a87-9c6597fadd03 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:28.723871 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-e6cc6603-47a6-4870-9a87-9c6597fadd03 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: cc0c06a0-156a-4cee-8ff7-92ab582bc4a1] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:28.732417 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e6cc6603-47a6-4870-9a87-9c6597fadd03 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:28.732790 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e6cc6603-47a6-4870-9a87-9c6597fadd03 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:28.733830 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e6cc6603-47a6-4870-9a87-9c6597fadd03 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:28.734321 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e6cc6603-47a6-4870-9a87-9c6597fadd03 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:28.747354 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:00:28.873253 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-719ccafd-a733-4e08-b1de-313ba648dbe7 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "POST /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229/action" status: 202 len: 0 microversion: 2.20 time: 0.293799 Jul 30 05:00:28.873873 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 148/318] 10.222.0.20 () {62 vars in 1319 bytes} [Sat Jul 30 05:00:28 2022] POST /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229/action => generated 0 bytes in 295 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 30 05:00:28.881244 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-5c6001af-bba7-45ce-8ac2-332107408be2 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:28.882186 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-5c6001af-bba7-45ce-8ac2-332107408be2 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] [instance: fdf672c0-82ac-413b-a8cc-e01a4de45c4e] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:28.889589 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5c6001af-bba7-45ce-8ac2-332107408be2 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:28.890384 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5c6001af-bba7-45ce-8ac2-332107408be2 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:28.891410 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-e6cc6603-47a6-4870-9a87-9c6597fadd03 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:28.891707 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5c6001af-bba7-45ce-8ac2-332107408be2 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:28.892363 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5c6001af-bba7-45ce-8ac2-332107408be2 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:28.901608 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-e6cc6603-47a6-4870-9a87-9c6597fadd03 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0c06a0-156a-4cee-8ff7-92ab582bc4a1" status: 200 len: 1523 microversion: 2.1 time: 0.183086 Jul 30 05:00:28.914780 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 171/319] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:28 2022] GET /compute/v2.1/servers/cc0c06a0-156a-4cee-8ff7-92ab582bc4a1 => generated 1523 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 05:00:28.914780 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-9945300b-ba8d-43aa-9465-c908c60b00a4 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:28.914780 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-9945300b-ba8d-43aa-9465-c908c60b00a4 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:28.920663 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9945300b-ba8d-43aa-9465-c908c60b00a4 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:28.922373 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9945300b-ba8d-43aa-9465-c908c60b00a4 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:28.922373 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9945300b-ba8d-43aa-9465-c908c60b00a4 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:28.923476 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9945300b-ba8d-43aa-9465-c908c60b00a4 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:29.007558 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-5c6001af-bba7-45ce-8ac2-332107408be2 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334f2d8d9d9a4f7a90586999398f8a40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a02f6df4ed4365b3ce1fa970f9cf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:29.015397 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-5c6001af-bba7-45ce-8ac2-332107408be2 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] 10.222.0.20 "GET /compute/v2.1/servers/fdf672c0-82ac-413b-a8cc-e01a4de45c4e" status: 200 len: 1288 microversion: 2.1 time: 0.140126 Jul 30 05:00:29.016070 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 149/320] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:28 2022] GET /compute/v2.1/servers/fdf672c0-82ac-413b-a8cc-e01a4de45c4e => generated 1288 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:00:29.076909 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-9945300b-ba8d-43aa-9465-c908c60b00a4 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:29.085229 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-9945300b-ba8d-43aa-9465-c908c60b00a4 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:29.086771 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-9945300b-ba8d-43aa-9465-c908c60b00a4 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:29.087946 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-9945300b-ba8d-43aa-9465-c908c60b00a4 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1723 microversion: 2.20 time: 0.183847 Jul 30 05:00:29.088492 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 172/321] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:00:28 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1723 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 05:00:29.676224 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-81a468ab-1c0b-4bbc-8a42-ad125bb02cd1 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:29.676921 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-81a468ab-1c0b-4bbc-8a42-ad125bb02cd1 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] [instance: 99b497c8-e641-428a-94b6-86c21af5844f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:29.683783 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-81a468ab-1c0b-4bbc-8a42-ad125bb02cd1 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:29.684678 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-81a468ab-1c0b-4bbc-8a42-ad125bb02cd1 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:29.686422 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-81a468ab-1c0b-4bbc-8a42-ad125bb02cd1 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:29.687173 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-81a468ab-1c0b-4bbc-8a42-ad125bb02cd1 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:29.926714 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-8fcee1a7-fec4-4bad-8f72-cc4935355288 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:29.927343 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-8fcee1a7-fec4-4bad-8f72-cc4935355288 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: cc0c06a0-156a-4cee-8ff7-92ab582bc4a1] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:29.929159 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-81a468ab-1c0b-4bbc-8a42-ad125bb02cd1 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a98edf8e5a4a22b3ae7d041b582b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76df23454a3c4a9bb4f61b044ed5a426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:29.937305 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-81a468ab-1c0b-4bbc-8a42-ad125bb02cd1 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] 10.222.0.20 "GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f" status: 200 len: 1257 microversion: 2.1 time: 0.265526 Jul 30 05:00:29.937905 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8fcee1a7-fec4-4bad-8f72-cc4935355288 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:29.938368 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8fcee1a7-fec4-4bad-8f72-cc4935355288 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:29.939187 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8fcee1a7-fec4-4bad-8f72-cc4935355288 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:29.939635 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8fcee1a7-fec4-4bad-8f72-cc4935355288 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:29.941654 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 150/322] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:29 2022] GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f => generated 1257 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:00:30.036704 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-94ef50d5-6aab-4437-b117-f8bef1e89389 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:30.037413 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-94ef50d5-6aab-4437-b117-f8bef1e89389 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] [instance: fdf672c0-82ac-413b-a8cc-e01a4de45c4e] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:30.046804 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-94ef50d5-6aab-4437-b117-f8bef1e89389 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:30.047259 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-94ef50d5-6aab-4437-b117-f8bef1e89389 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:30.048040 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-94ef50d5-6aab-4437-b117-f8bef1e89389 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:30.048478 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-94ef50d5-6aab-4437-b117-f8bef1e89389 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:30.201647 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-8fcee1a7-fec4-4bad-8f72-cc4935355288 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:30.210822 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-8fcee1a7-fec4-4bad-8f72-cc4935355288 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0c06a0-156a-4cee-8ff7-92ab582bc4a1" status: 200 len: 1503 microversion: 2.1 time: 0.288375 Jul 30 05:00:30.211805 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 173/323] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:29 2022] GET /compute/v2.1/servers/cc0c06a0-156a-4cee-8ff7-92ab582bc4a1 => generated 1503 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:00:30.235400 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-7e0b3255-a313-4ae1-9dc2-0c506340710c tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:30.235528 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-7e0b3255-a313-4ae1-9dc2-0c506340710c tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:30.242552 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7e0b3255-a313-4ae1-9dc2-0c506340710c tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:30.243613 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7e0b3255-a313-4ae1-9dc2-0c506340710c tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:30.244531 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7e0b3255-a313-4ae1-9dc2-0c506340710c tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:30.244981 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7e0b3255-a313-4ae1-9dc2-0c506340710c tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:30.432359 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-7e0b3255-a313-4ae1-9dc2-0c506340710c tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:30.451907 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-7e0b3255-a313-4ae1-9dc2-0c506340710c tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:30.453540 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-7e0b3255-a313-4ae1-9dc2-0c506340710c tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:30.454682 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-7e0b3255-a313-4ae1-9dc2-0c506340710c tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1723 microversion: 2.20 time: 0.230616 Jul 30 05:00:30.455310 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 174/324] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:00:30 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1723 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 05:00:30.463793 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-706ca7bb-5509-4436-b012-0fed14b2640c tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "853372c6-b8ea-460d-9ef8-44817989cb0f"}} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:00:30.467568 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-706ca7bb-5509-4436-b012-0fed14b2640c tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: cc0c06a0-156a-4cee-8ff7-92ab582bc4a1] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:30.476313 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-706ca7bb-5509-4436-b012-0fed14b2640c tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:30.477105 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-706ca7bb-5509-4436-b012-0fed14b2640c tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:30.478132 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-706ca7bb-5509-4436-b012-0fed14b2640c tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:30.478847 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-706ca7bb-5509-4436-b012-0fed14b2640c tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:30.507826 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.wsgi [None req-706ca7bb-5509-4436-b012-0fed14b2640c tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] HTTP exception thrown: Cannot 'attach_volume' instance cc0c06a0-156a-4cee-8ff7-92ab582bc4a1 while it is in vm_state rescued Jul 30 05:00:30.510063 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-706ca7bb-5509-4436-b012-0fed14b2640c tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Request method failure captured: Jul 30 05:00:30.510063 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: request: POST /compute/v2.1/servers/cc0c06a0-156a-4cee-8ff7-92ab582bc4a1/os-volume_attachments HTTP/1.1 Jul 30 05:00:30.510063 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Accept: application/json Jul 30 05:00:30.510063 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Accept-Encoding: identity Jul 30 05:00:30.510063 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Connection: close Jul 30 05:00:30.510063 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Content-Length: 74 Jul 30 05:00:30.510063 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Content-Type: application/json Jul 30 05:00:30.510063 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Host: 10.222.0.20 Jul 30 05:00:30.510063 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Openstack-System-Scope: None Jul 30 05:00:30.510063 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: User-Agent: python-urllib3/1.26.10 Jul 30 05:00:30.510063 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Auth-Token: gAAAAABi5Lpu5KZ-sBOjkiuZTtNR2YWcqU_r-_-3UQQ04xAT-w7gK_BuaWmEOr5Ju1pwtkZZzl_OTo-ZEKY-uHmyReS4PYVQ4M2aEskgI5yNySqgQDIjC3jupbHgF4azyUEFhR8JjMfCOfjvUulaZeOLaDw7yo-4-VTWVyQqf3A9DFmnALqdkU8 Jul 30 05:00:30.510063 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Domain-Id: None Jul 30 05:00:30.510063 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Domain-Name: None Jul 30 05:00:30.510063 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Identity-Status: Confirmed Jul 30 05:00:30.510063 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Is-Admin-Project: True Jul 30 05:00:30.510063 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Project-Domain-Id: default Jul 30 05:00:30.510063 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Project-Domain-Name: Default Jul 30 05:00:30.510063 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Project-Id: decb0bd64582440590890900e594b79e Jul 30 05:00:30.510063 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-243408600 Jul 30 05:00:30.510063 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Role: member,reader Jul 30 05:00:30.510063 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Roles: member,reader Jul 30 05:00:30.511424 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/decb0bd64582440590890900e594b79e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/decb0bd64582440590890900e594b79e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_decb0bd64582440590890900e594b79e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/decb0bd64582440590890900e594b79e"}]}] Jul 30 05:00:30.511424 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Tenant: tempest-ServerRescueNegativeTestJSON-243408600 Jul 30 05:00:30.511424 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Tenant-Id: decb0bd64582440590890900e594b79e Jul 30 05:00:30.511424 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-243408600 Jul 30 05:00:30.511424 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User: tempest-ServerRescueNegativeTestJSON-243408600-project Jul 30 05:00:30.511424 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User-Domain-Id: default Jul 30 05:00:30.511424 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User-Domain-Name: Default Jul 30 05:00:30.511424 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User-Id: 25db6f7402ae4a14a04fab0a9915ab77 Jul 30 05:00:30.511424 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User-Name: tempest-ServerRescueNegativeTestJSON-243408600-project Jul 30 05:00:30.511424 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Jul 30 05:00:30.511424 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: {"volumeAttachment": {"volumeId": "853372c6-b8ea-460d-9ef8-44817989cb0f"}} Jul 30 05:00:30.511424 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: method: > Jul 30 05:00:30.512155 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: exception: Cannot 'attach_volume' instance cc0c06a0-156a-4cee-8ff7-92ab582bc4a1 while it is in vm_state rescued Jul 30 05:00:30.512155 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: action_args: {'server_id': 'cc0c06a0-156a-4cee-8ff7-92ab582bc4a1', 'body': {'volumeAttachment': {'volumeId': '853372c6-b8ea-460d-9ef8-44817989cb0f'}}} Jul 30 05:00:30.512155 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 05:00:30.512155 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:00:30.512155 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 30 05:00:30.512155 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 30 05:00:30.512155 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 30 05:00:30.512155 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 30 05:00:30.512155 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 30 05:00:30.512155 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 30 05:00:30.512155 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance cc0c06a0-156a-4cee-8ff7-92ab582bc4a1 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 30 05:00:30.512155 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 05:00:30.512155 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 05:00:30.512155 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 05:00:30.512155 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:00:30.512155 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 05:00:30.512155 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 05:00:30.512155 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 05:00:30.512155 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 05:00:30.513415 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 05:00:30.513415 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 05:00:30.513415 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 05:00:30.513415 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 05:00:30.513415 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 05:00:30.513415 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 05:00:30.513415 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 05:00:30.513415 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 05:00:30.513415 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 30 05:00:30.513415 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 30 05:00:30.513415 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 30 05:00:30.513415 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 30 05:00:30.513415 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance cc0c06a0-156a-4cee-8ff7-92ab582bc4a1 while it is in vm_state rescued Jul 30 05:00:30.513415 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 05:00:30.513415 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 05:00:30.513415 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 05:00:30.513415 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:00:30.513415 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 05:00:30.513415 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 05:00:30.514597 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 05:00:30.514597 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 05:00:30.514597 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance cc0c06a0-156a-4cee-8ff7-92ab582bc4a1 while it is in vm_state rescued Jul 30 05:00:30.514597 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 05:00:30.514597 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-706ca7bb-5509-4436-b012-0fed14b2640c tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Returning 409 to user: Cannot 'attach_volume' instance cc0c06a0-156a-4cee-8ff7-92ab582bc4a1 while it is in vm_state rescued {{(pid=117886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 05:00:30.514597 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-706ca7bb-5509-4436-b012-0fed14b2640c tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "POST /compute/v2.1/servers/cc0c06a0-156a-4cee-8ff7-92ab582bc4a1/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.053942 Jul 30 05:00:30.514597 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 175/325] 10.222.0.20 () {60 vars in 1323 bytes} [Sat Jul 30 05:00:30 2022] POST /compute/v2.1/servers/cc0c06a0-156a-4cee-8ff7-92ab582bc4a1/os-volume_attachments => generated 152 bytes in 56 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 30 05:00:30.521355 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-317f817e-e7ff-4a3a-90c0-1f511921951a tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:00:30.521896 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-317f817e-e7ff-4a3a-90c0-1f511921951a tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: cc0c06a0-156a-4cee-8ff7-92ab582bc4a1] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:30.529054 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-317f817e-e7ff-4a3a-90c0-1f511921951a tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:30.529544 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-317f817e-e7ff-4a3a-90c0-1f511921951a tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:30.530708 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-317f817e-e7ff-4a3a-90c0-1f511921951a tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:30.531379 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-317f817e-e7ff-4a3a-90c0-1f511921951a tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:30.605677 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-94ef50d5-6aab-4437-b117-f8bef1e89389 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334f2d8d9d9a4f7a90586999398f8a40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a02f6df4ed4365b3ce1fa970f9cf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:30.626925 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-94ef50d5-6aab-4437-b117-f8bef1e89389 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] 10.222.0.20 "GET /compute/v2.1/servers/fdf672c0-82ac-413b-a8cc-e01a4de45c4e" status: 200 len: 1318 microversion: 2.1 time: 0.593773 Jul 30 05:00:30.636751 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-317f817e-e7ff-4a3a-90c0-1f511921951a tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "POST /compute/v2.1/servers/cc0c06a0-156a-4cee-8ff7-92ab582bc4a1/action" status: 202 len: 0 microversion: 2.1 time: 0.119362 Jul 30 05:00:30.641801 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 176/326] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Jul 30 05:00:30 2022] POST /compute/v2.1/servers/cc0c06a0-156a-4cee-8ff7-92ab582bc4a1/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 05:00:30.646513 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 151/327] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:30 2022] GET /compute/v2.1/servers/fdf672c0-82ac-413b-a8cc-e01a4de45c4e => generated 1318 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:00:30.648196 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-36a5f76d-dbdc-48f8-ae1c-30365286b87d tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:30.649259 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-36a5f76d-dbdc-48f8-ae1c-30365286b87d tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: cc0c06a0-156a-4cee-8ff7-92ab582bc4a1] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:30.656978 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-36a5f76d-dbdc-48f8-ae1c-30365286b87d tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:30.657466 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-36a5f76d-dbdc-48f8-ae1c-30365286b87d tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:30.658706 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-36a5f76d-dbdc-48f8-ae1c-30365286b87d tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:30.659375 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-36a5f76d-dbdc-48f8-ae1c-30365286b87d tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:30.861157 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-36a5f76d-dbdc-48f8-ae1c-30365286b87d tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:30.871891 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-36a5f76d-dbdc-48f8-ae1c-30365286b87d tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0c06a0-156a-4cee-8ff7-92ab582bc4a1" status: 200 len: 1511 microversion: 2.1 time: 0.228404 Jul 30 05:00:30.873145 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 177/328] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:30 2022] GET /compute/v2.1/servers/cc0c06a0-156a-4cee-8ff7-92ab582bc4a1 => generated 1511 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:00:30.966977 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-d54e0dfc-86aa-41f4-a8d7-83ff0e11ce79 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:30.969024 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-d54e0dfc-86aa-41f4-a8d7-83ff0e11ce79 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] [instance: 99b497c8-e641-428a-94b6-86c21af5844f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:30.988609 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d54e0dfc-86aa-41f4-a8d7-83ff0e11ce79 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:30.993114 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d54e0dfc-86aa-41f4-a8d7-83ff0e11ce79 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:30.995400 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d54e0dfc-86aa-41f4-a8d7-83ff0e11ce79 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:30.996859 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d54e0dfc-86aa-41f4-a8d7-83ff0e11ce79 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:31.030586 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-3ffaab87-94a7-4fa5-8722-ded67e89c9a4 req-efc3071e-530d-4283-a8bd-5a32d35bfe10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdf672c0-82ac-413b-a8cc-e01a4de45c4e", "tag": "489c2188-4f11-4296-9de5-6a7a8bb1a9dd"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:00:31.051540 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-3ffaab87-94a7-4fa5-8722-ded67e89c9a4 req-efc3071e-530d-4283-a8bd-5a32d35bfe10 service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:31.052322 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-3ffaab87-94a7-4fa5-8722-ded67e89c9a4 req-efc3071e-530d-4283-a8bd-5a32d35bfe10 service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:31.064104 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-3ffaab87-94a7-4fa5-8722-ded67e89c9a4 req-efc3071e-530d-4283-a8bd-5a32d35bfe10 service nova] Creating event network-changed:489c2188-4f11-4296-9de5-6a7a8bb1a9dd for instance fdf672c0-82ac-413b-a8cc-e01a4de45c4e on hv-cinder-85127 Jul 30 05:00:31.076604 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-3ffaab87-94a7-4fa5-8722-ded67e89c9a4 req-efc3071e-530d-4283-a8bd-5a32d35bfe10 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044754 Jul 30 05:00:31.076604 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 178/329] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Jul 30 05:00:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 05:00:31.269956 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-d54e0dfc-86aa-41f4-a8d7-83ff0e11ce79 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a98edf8e5a4a22b3ae7d041b582b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76df23454a3c4a9bb4f61b044ed5a426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:31.287551 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-d54e0dfc-86aa-41f4-a8d7-83ff0e11ce79 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] 10.222.0.20 "GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f" status: 200 len: 1440 microversion: 2.1 time: 0.329949 Jul 30 05:00:31.288410 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 152/330] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:30 2022] GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f => generated 1440 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:00:31.317231 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-9eb4036c-d3d9-41a0-b14b-eb345cdaadaf tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:31.318991 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-9eb4036c-d3d9-41a0-b14b-eb345cdaadaf tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] [instance: 99b497c8-e641-428a-94b6-86c21af5844f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:31.329621 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9eb4036c-d3d9-41a0-b14b-eb345cdaadaf tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:31.331455 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9eb4036c-d3d9-41a0-b14b-eb345cdaadaf tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:31.332729 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9eb4036c-d3d9-41a0-b14b-eb345cdaadaf tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:31.333634 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9eb4036c-d3d9-41a0-b14b-eb345cdaadaf tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:31.491327 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-65053d3f-61a7-49a1-a3ac-edd940e9a506 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:31.494367 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-65053d3f-61a7-49a1-a3ac-edd940e9a506 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:31.511651 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-65053d3f-61a7-49a1-a3ac-edd940e9a506 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:31.512013 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-65053d3f-61a7-49a1-a3ac-edd940e9a506 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:31.512941 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-65053d3f-61a7-49a1-a3ac-edd940e9a506 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:31.513391 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-65053d3f-61a7-49a1-a3ac-edd940e9a506 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:31.570070 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-9eb4036c-d3d9-41a0-b14b-eb345cdaadaf tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a98edf8e5a4a22b3ae7d041b582b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76df23454a3c4a9bb4f61b044ed5a426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:31.579896 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-9eb4036c-d3d9-41a0-b14b-eb345cdaadaf tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] 10.222.0.20 "GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f" status: 200 len: 1440 microversion: 2.1 time: 0.271482 Jul 30 05:00:31.580488 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 179/331] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:31 2022] GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f => generated 1440 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:00:31.652792 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-936a5e9b-fc06-46ef-83fb-1f4f74a83af8 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:31.653213 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-936a5e9b-fc06-46ef-83fb-1f4f74a83af8 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] [instance: fdf672c0-82ac-413b-a8cc-e01a4de45c4e] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:31.673422 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-936a5e9b-fc06-46ef-83fb-1f4f74a83af8 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:31.673893 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-936a5e9b-fc06-46ef-83fb-1f4f74a83af8 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:31.676544 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-936a5e9b-fc06-46ef-83fb-1f4f74a83af8 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:31.677038 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-936a5e9b-fc06-46ef-83fb-1f4f74a83af8 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:31.773980 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-65053d3f-61a7-49a1-a3ac-edd940e9a506 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:31.782739 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-65053d3f-61a7-49a1-a3ac-edd940e9a506 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:31.785525 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-65053d3f-61a7-49a1-a3ac-edd940e9a506 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:31.787032 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-65053d3f-61a7-49a1-a3ac-edd940e9a506 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1723 microversion: 2.20 time: 0.311164 Jul 30 05:00:31.789390 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 153/332] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:00:31 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1723 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 05:00:31.855744 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-936a5e9b-fc06-46ef-83fb-1f4f74a83af8 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334f2d8d9d9a4f7a90586999398f8a40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a02f6df4ed4365b3ce1fa970f9cf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:31.864930 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-936a5e9b-fc06-46ef-83fb-1f4f74a83af8 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] 10.222.0.20 "GET /compute/v2.1/servers/fdf672c0-82ac-413b-a8cc-e01a4de45c4e" status: 200 len: 1318 microversion: 2.1 time: 0.219273 Jul 30 05:00:31.865747 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 180/333] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:31 2022] GET /compute/v2.1/servers/fdf672c0-82ac-413b-a8cc-e01a4de45c4e => generated 1318 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:00:31.895578 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-c70c8a6b-10ff-43c5-b9ce-69182bcab5b4 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:31.896513 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-c70c8a6b-10ff-43c5-b9ce-69182bcab5b4 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: cc0c06a0-156a-4cee-8ff7-92ab582bc4a1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:31.910870 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c70c8a6b-10ff-43c5-b9ce-69182bcab5b4 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:31.911498 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c70c8a6b-10ff-43c5-b9ce-69182bcab5b4 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:31.912395 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c70c8a6b-10ff-43c5-b9ce-69182bcab5b4 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:31.912841 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c70c8a6b-10ff-43c5-b9ce-69182bcab5b4 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:32.298379 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-c70c8a6b-10ff-43c5-b9ce-69182bcab5b4 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:32.307578 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-c70c8a6b-10ff-43c5-b9ce-69182bcab5b4 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0c06a0-156a-4cee-8ff7-92ab582bc4a1" status: 200 len: 1511 microversion: 2.1 time: 0.416411 Jul 30 05:00:32.308938 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 154/334] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:31 2022] GET /compute/v2.1/servers/cc0c06a0-156a-4cee-8ff7-92ab582bc4a1 => generated 1511 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:00:32.370520 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-cb1a7a59-80e4-4037-ac7a-96a852658e26 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Action: 'create', calling method: .version_select at 0x7f2db4214d30>, body: {"keypair": {"name": "tempest-keypair-790956935", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKsexY+50HXNiPnB6BBydrto5YlzhMlB9/wXujJhT8Ke99I08dBklo/4pQBqnIdM1fluCYOLID9NGVjmKwuaUF/pqLD3wZIPJnEeHY/QYgTAUju1pccEshIc/UiNWMxliA=="}} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:00:32.389807 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.quota [None req-cb1a7a59-80e4-4037-ac7a-96a852658e26 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Getting quotas for project e01500cb03c74d1082090cd1c1836169. Resources: {'key_pairs'} {{(pid=117886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 05:00:32.395835 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.quota [None req-cb1a7a59-80e4-4037-ac7a-96a852658e26 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Getting quotas for user a8abb58f9c274e568d2d0fe3d4df11de and project e01500cb03c74d1082090cd1c1836169. Resources: {'key_pairs'} {{(pid=117886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 05:00:32.430856 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-cb1a7a59-80e4-4037-ac7a-96a852658e26 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.065109 Jul 30 05:00:32.431989 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 181/335] 10.222.0.20 () {60 vars in 1159 bytes} [Sat Jul 30 05:00:32 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 05:00:32.818860 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-25db7a25-3a66-46d4-ac70-2770b0a34440 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:32.819843 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-25db7a25-3a66-46d4-ac70-2770b0a34440 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:32.830381 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-25db7a25-3a66-46d4-ac70-2770b0a34440 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:32.832153 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-25db7a25-3a66-46d4-ac70-2770b0a34440 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:32.833968 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-25db7a25-3a66-46d4-ac70-2770b0a34440 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:32.835794 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-25db7a25-3a66-46d4-ac70-2770b0a34440 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:32.886416 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-45a70e42-2033-4f3c-a5b8-22b88d9d533d tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:32.887062 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-45a70e42-2033-4f3c-a5b8-22b88d9d533d tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] [instance: fdf672c0-82ac-413b-a8cc-e01a4de45c4e] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:32.904337 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-45a70e42-2033-4f3c-a5b8-22b88d9d533d tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:32.904793 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-45a70e42-2033-4f3c-a5b8-22b88d9d533d tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:32.905584 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-45a70e42-2033-4f3c-a5b8-22b88d9d533d tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:32.906024 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-45a70e42-2033-4f3c-a5b8-22b88d9d533d tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:33.192429 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-45a70e42-2033-4f3c-a5b8-22b88d9d533d tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334f2d8d9d9a4f7a90586999398f8a40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a02f6df4ed4365b3ce1fa970f9cf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:33.204227 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-45a70e42-2033-4f3c-a5b8-22b88d9d533d tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] 10.222.0.20 "GET /compute/v2.1/servers/fdf672c0-82ac-413b-a8cc-e01a4de45c4e" status: 200 len: 1318 microversion: 2.1 time: 0.321617 Jul 30 05:00:33.204814 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 182/336] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:32 2022] GET /compute/v2.1/servers/fdf672c0-82ac-413b-a8cc-e01a4de45c4e => generated 1318 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 05:00:33.268814 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-25db7a25-3a66-46d4-ac70-2770b0a34440 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:33.284465 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-25db7a25-3a66-46d4-ac70-2770b0a34440 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:33.286088 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-25db7a25-3a66-46d4-ac70-2770b0a34440 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:33.287387 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-25db7a25-3a66-46d4-ac70-2770b0a34440 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1723 microversion: 2.20 time: 0.475113 Jul 30 05:00:33.288085 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 155/337] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:00:32 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1723 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 05:00:33.329579 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-c39489cc-b91a-445a-b19d-71e20eaa9a35 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:33.331173 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-c39489cc-b91a-445a-b19d-71e20eaa9a35 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: cc0c06a0-156a-4cee-8ff7-92ab582bc4a1] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:33.338482 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c39489cc-b91a-445a-b19d-71e20eaa9a35 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:33.340024 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c39489cc-b91a-445a-b19d-71e20eaa9a35 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:33.341402 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c39489cc-b91a-445a-b19d-71e20eaa9a35 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:33.342080 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c39489cc-b91a-445a-b19d-71e20eaa9a35 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:33.752473 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-c39489cc-b91a-445a-b19d-71e20eaa9a35 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:33.764774 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-c39489cc-b91a-445a-b19d-71e20eaa9a35 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0c06a0-156a-4cee-8ff7-92ab582bc4a1" status: 200 len: 1511 microversion: 2.1 time: 0.439031 Jul 30 05:00:33.765352 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 183/338] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:33 2022] GET /compute/v2.1/servers/cc0c06a0-156a-4cee-8ff7-92ab582bc4a1 => generated 1511 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:00:34.224833 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-a756e217-b50b-46e6-9f15-0e26f1d1bf94 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:34.225442 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-a756e217-b50b-46e6-9f15-0e26f1d1bf94 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] [instance: fdf672c0-82ac-413b-a8cc-e01a4de45c4e] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:34.232961 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a756e217-b50b-46e6-9f15-0e26f1d1bf94 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:34.234835 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a756e217-b50b-46e6-9f15-0e26f1d1bf94 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:34.235981 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a756e217-b50b-46e6-9f15-0e26f1d1bf94 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:34.236724 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a756e217-b50b-46e6-9f15-0e26f1d1bf94 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:34.312148 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-6a1bea72-276d-4755-a319-b3022048f1d6 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:34.312755 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-6a1bea72-276d-4755-a319-b3022048f1d6 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:34.336411 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6a1bea72-276d-4755-a319-b3022048f1d6 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:34.336859 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6a1bea72-276d-4755-a319-b3022048f1d6 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:34.337624 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6a1bea72-276d-4755-a319-b3022048f1d6 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:34.338082 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6a1bea72-276d-4755-a319-b3022048f1d6 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:34.541439 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-a756e217-b50b-46e6-9f15-0e26f1d1bf94 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334f2d8d9d9a4f7a90586999398f8a40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a02f6df4ed4365b3ce1fa970f9cf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:34.559507 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-a756e217-b50b-46e6-9f15-0e26f1d1bf94 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] 10.222.0.20 "GET /compute/v2.1/servers/fdf672c0-82ac-413b-a8cc-e01a4de45c4e" status: 200 len: 1318 microversion: 2.1 time: 0.338033 Jul 30 05:00:34.561635 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 156/339] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:34 2022] GET /compute/v2.1/servers/fdf672c0-82ac-413b-a8cc-e01a4de45c4e => generated 1318 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:00:34.610136 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-6a1bea72-276d-4755-a319-b3022048f1d6 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:34.622317 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-6a1bea72-276d-4755-a319-b3022048f1d6 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:34.630481 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-6a1bea72-276d-4755-a319-b3022048f1d6 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:34.632061 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-6a1bea72-276d-4755-a319-b3022048f1d6 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1723 microversion: 2.20 time: 0.323837 Jul 30 05:00:34.633080 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 184/340] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:00:34 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1723 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 05:00:34.656069 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-5972e174-77c6-444d-991b-0fe2e8f954ca req-0f26e9bb-7123-4128-b6c2-3c63fb7c7ba0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99b497c8-e641-428a-94b6-86c21af5844f", "tag": "1a76ab0f-eada-4891-8b4c-b2af44036eb1"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:00:34.678044 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-5972e174-77c6-444d-991b-0fe2e8f954ca req-0f26e9bb-7123-4128-b6c2-3c63fb7c7ba0 service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:34.678824 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-5972e174-77c6-444d-991b-0fe2e8f954ca req-0f26e9bb-7123-4128-b6c2-3c63fb7c7ba0 service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:34.692931 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-5972e174-77c6-444d-991b-0fe2e8f954ca req-0f26e9bb-7123-4128-b6c2-3c63fb7c7ba0 service nova] Creating event network-changed:1a76ab0f-eada-4891-8b4c-b2af44036eb1 for instance 99b497c8-e641-428a-94b6-86c21af5844f on hv-cinder-85127 Jul 30 05:00:34.698820 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-5972e174-77c6-444d-991b-0fe2e8f954ca req-0f26e9bb-7123-4128-b6c2-3c63fb7c7ba0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047242 Jul 30 05:00:34.699828 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 157/341] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Jul 30 05:00:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 05:00:34.787595 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-4fdafc96-44a9-4153-a411-09e4b87c4482 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:34.788399 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-4fdafc96-44a9-4153-a411-09e4b87c4482 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: cc0c06a0-156a-4cee-8ff7-92ab582bc4a1] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:34.790768 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell0:SELECT=2 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:00:34.797512 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4fdafc96-44a9-4153-a411-09e4b87c4482 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:34.798118 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4fdafc96-44a9-4153-a411-09e4b87c4482 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:34.799365 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4fdafc96-44a9-4153-a411-09e4b87c4482 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:34.800493 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4fdafc96-44a9-4153-a411-09e4b87c4482 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:34.958130 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-4fdafc96-44a9-4153-a411-09e4b87c4482 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:34.967389 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-4fdafc96-44a9-4153-a411-09e4b87c4482 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0c06a0-156a-4cee-8ff7-92ab582bc4a1" status: 200 len: 1511 microversion: 2.1 time: 0.184826 Jul 30 05:00:34.968137 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 185/342] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:34 2022] GET /compute/v2.1/servers/cc0c06a0-156a-4cee-8ff7-92ab582bc4a1 => generated 1511 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:00:35.017476 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-042cf311-975a-463a-b387-c76bbe06c24b tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1932713128", "imageRef": "d6a9c8e1-ecb9-4603-bb88-2b0d46ac2387", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "afd82f39-2725-4de8-bc03-d4d225abc92e"}], "security_groups": [{"name": "tempest-securitygroup--1772467052"}], "key_name": "tempest-keypair-790956935", "user_data": "}} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:00:35.128944 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.network.neutron [None req-042cf311-975a-463a-b387-c76bbe06c24b tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] validate_networks() for [('afd82f39-2725-4de8-bc03-d4d225abc92e', None, None, None, None, None)] {{(pid=117885) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 05:00:35.438600 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-fdbf4a32-9799-4000-bdb1-4d014878d8c1 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-625626113", "imageRef": "d6a9c8e1-ecb9-4603-bb88-2b0d46ac2387", "flavorRef": "452", "networks": [{"uuid": "67254df2-69cc-4935-a78a-856ecd4c2eaf"}]}} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:00:35.495323 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.network.neutron [None req-fdbf4a32-9799-4000-bdb1-4d014878d8c1 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] validate_networks() for [('67254df2-69cc-4935-a78a-856ecd4c2eaf', None, None, None, None, None)] {{(pid=117886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 05:00:35.744820 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-042cf311-975a-463a-b387-c76bbe06c24b tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Flavor limits 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 05:00:35.745970 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-042cf311-975a-463a-b387-c76bbe06c24b tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Image limits 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 05:00:35.746266 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-042cf311-975a-463a-b387-c76bbe06c24b tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Flavor pref 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 05:00:35.747264 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-042cf311-975a-463a-b387-c76bbe06c24b tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Image pref 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 05:00:35.747691 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-042cf311-975a-463a-b387-c76bbe06c24b tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 05:00:35.759540 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-042cf311-975a-463a-b387-c76bbe06c24b tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:35.760026 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-042cf311-975a-463a-b387-c76bbe06c24b tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:35.760828 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-042cf311-975a-463a-b387-c76bbe06c24b tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:35.761435 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-042cf311-975a-463a-b387-c76bbe06c24b tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:35.784646 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.quota [None req-042cf311-975a-463a-b387-c76bbe06c24b tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Getting quotas for project e01500cb03c74d1082090cd1c1836169. Resources: {'ram', 'cores', 'instances'} {{(pid=117885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 05:00:35.789798 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.quota [None req-042cf311-975a-463a-b387-c76bbe06c24b tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Getting quotas for user a8abb58f9c274e568d2d0fe3d4df11de and project e01500cb03c74d1082090cd1c1836169. Resources: {'ram', 'cores', 'instances'} {{(pid=117885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 05:00:35.802757 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-042cf311-975a-463a-b387-c76bbe06c24b tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Going to run 1 instances... {{(pid=117885) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 05:00:35.805292 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-042cf311-975a-463a-b387-c76bbe06c24b tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: 22fe5ad8-01f8-4d0a-bb24-7c23a427d328] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d6a9c8e1-ecb9-4603-bb88-2b0d46ac2387',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 05:00:35.858369 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-042cf311-975a-463a-b387-c76bbe06c24b tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.845619 Jul 30 05:00:35.859400 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 158/343] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Jul 30 05:00:35 2022] POST /compute/v2.1/servers => generated 402 bytes in 847 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 05:00:35.865136 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-9c5bf1fc-6ebb-4b89-87e1-5e114ae69197 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:35.865766 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-9c5bf1fc-6ebb-4b89-87e1-5e114ae69197 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] [instance: fdf672c0-82ac-413b-a8cc-e01a4de45c4e] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:35.872782 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9c5bf1fc-6ebb-4b89-87e1-5e114ae69197 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:35.873458 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9c5bf1fc-6ebb-4b89-87e1-5e114ae69197 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:35.874426 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9c5bf1fc-6ebb-4b89-87e1-5e114ae69197 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:35.875038 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9c5bf1fc-6ebb-4b89-87e1-5e114ae69197 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:35.897772 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-fdbf4a32-9799-4000-bdb1-4d014878d8c1 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Flavor limits 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 05:00:35.898229 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-fdbf4a32-9799-4000-bdb1-4d014878d8c1 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Image limits 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 05:00:35.898951 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-fdbf4a32-9799-4000-bdb1-4d014878d8c1 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Flavor pref 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 05:00:35.899465 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-fdbf4a32-9799-4000-bdb1-4d014878d8c1 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Image pref 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 05:00:35.899976 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-fdbf4a32-9799-4000-bdb1-4d014878d8c1 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 05:00:35.924567 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fdbf4a32-9799-4000-bdb1-4d014878d8c1 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:35.925017 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fdbf4a32-9799-4000-bdb1-4d014878d8c1 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:35.926169 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fdbf4a32-9799-4000-bdb1-4d014878d8c1 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:35.926867 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fdbf4a32-9799-4000-bdb1-4d014878d8c1 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:35.936311 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:00:35.953259 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.quota [None req-fdbf4a32-9799-4000-bdb1-4d014878d8c1 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Getting quotas for project f102af4a74e946caa9fefc7ad0ae148c. Resources: {'ram', 'cores', 'instances'} {{(pid=117886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 05:00:35.956833 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:00:35.960764 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.quota [None req-fdbf4a32-9799-4000-bdb1-4d014878d8c1 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Getting quotas for user b98e41589d15488380a43000a82c2b3c and project f102af4a74e946caa9fefc7ad0ae148c. Resources: {'ram', 'cores', 'instances'} {{(pid=117886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 05:00:35.981901 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-fdbf4a32-9799-4000-bdb1-4d014878d8c1 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Going to run 1 instances... {{(pid=117886) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 05:00:35.984514 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-fdbf4a32-9799-4000-bdb1-4d014878d8c1 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] [instance: 8df9803f-05b0-4d65-aada-31539d50706f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d6a9c8e1-ecb9-4603-bb88-2b0d46ac2387',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 05:00:36.052213 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-fdbf4a32-9799-4000-bdb1-4d014878d8c1 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.617870 Jul 30 05:00:36.052784 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 186/344] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Jul 30 05:00:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 619 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 05:00:36.057875 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-9c5bf1fc-6ebb-4b89-87e1-5e114ae69197 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334f2d8d9d9a4f7a90586999398f8a40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a02f6df4ed4365b3ce1fa970f9cf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:36.058469 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-a84967cf-a454-44c1-aeff-c02851fdbe40 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:36.059394 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-a84967cf-a454-44c1-aeff-c02851fdbe40 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:36.067280 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a84967cf-a454-44c1-aeff-c02851fdbe40 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:36.068131 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a84967cf-a454-44c1-aeff-c02851fdbe40 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:36.069061 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a84967cf-a454-44c1-aeff-c02851fdbe40 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:36.070118 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a84967cf-a454-44c1-aeff-c02851fdbe40 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:36.080516 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-9c5bf1fc-6ebb-4b89-87e1-5e114ae69197 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] 10.222.0.20 "GET /compute/v2.1/servers/fdf672c0-82ac-413b-a8cc-e01a4de45c4e" status: 200 len: 1318 microversion: 2.1 time: 0.219939 Jul 30 05:00:36.094083 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 159/345] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:35 2022] GET /compute/v2.1/servers/fdf672c0-82ac-413b-a8cc-e01a4de45c4e => generated 1318 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:00:36.099286 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-86151c9b-9871-4041-94c7-b8b92758b0c6 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:36.099909 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-86151c9b-9871-4041-94c7-b8b92758b0c6 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: 22fe5ad8-01f8-4d0a-bb24-7c23a427d328] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:36.190525 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-86151c9b-9871-4041-94c7-b8b92758b0c6 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8abb58f9c274e568d2d0fe3d4df11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01500cb03c74d1082090cd1c1836169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:36.198335 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-86151c9b-9871-4041-94c7-b8b92758b0c6 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/22fe5ad8-01f8-4d0a-bb24-7c23a427d328" status: 200 len: 1241 microversion: 2.1 time: 0.103118 Jul 30 05:00:36.210842 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 160/346] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:36 2022] GET /compute/v2.1/servers/22fe5ad8-01f8-4d0a-bb24-7c23a427d328 => generated 1241 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:00:36.218111 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-b3a9ee12-1be8-42eb-9e3d-3befaecdfa3e tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:36.218759 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-b3a9ee12-1be8-42eb-9e3d-3befaecdfa3e tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: cc0c06a0-156a-4cee-8ff7-92ab582bc4a1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:36.234234 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b3a9ee12-1be8-42eb-9e3d-3befaecdfa3e tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:36.234807 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b3a9ee12-1be8-42eb-9e3d-3befaecdfa3e tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:36.235564 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b3a9ee12-1be8-42eb-9e3d-3befaecdfa3e tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:36.236008 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b3a9ee12-1be8-42eb-9e3d-3befaecdfa3e tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:36.301224 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-a84967cf-a454-44c1-aeff-c02851fdbe40 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:36.312501 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-a84967cf-a454-44c1-aeff-c02851fdbe40 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:36.317914 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-a84967cf-a454-44c1-aeff-c02851fdbe40 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:36.320781 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-a84967cf-a454-44c1-aeff-c02851fdbe40 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1723 microversion: 2.20 time: 0.266711 Jul 30 05:00:36.321727 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 187/347] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:00:36 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1723 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 05:00:36.327075 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-c5ca9f03-d455-43a5-bcf4-e28a623153ba tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:36.328123 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-c5ca9f03-d455-43a5-bcf4-e28a623153ba tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] [instance: 8df9803f-05b0-4d65-aada-31539d50706f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:36.413080 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-c5ca9f03-d455-43a5-bcf4-e28a623153ba tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98e41589d15488380a43000a82c2b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f102af4a74e946caa9fefc7ad0ae148c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:36.424027 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-c5ca9f03-d455-43a5-bcf4-e28a623153ba tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] 10.222.0.20 "GET /compute/v2.1/servers/8df9803f-05b0-4d65-aada-31539d50706f" status: 200 len: 1213 microversion: 2.1 time: 0.101167 Jul 30 05:00:36.426173 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 188/348] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:36 2022] GET /compute/v2.1/servers/8df9803f-05b0-4d65-aada-31539d50706f => generated 1213 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:00:36.447515 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-b3a9ee12-1be8-42eb-9e3d-3befaecdfa3e tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:36.458621 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-b3a9ee12-1be8-42eb-9e3d-3befaecdfa3e tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0c06a0-156a-4cee-8ff7-92ab582bc4a1" status: 200 len: 1511 microversion: 2.1 time: 0.246529 Jul 30 05:00:36.459200 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 161/349] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:36 2022] GET /compute/v2.1/servers/cc0c06a0-156a-4cee-8ff7-92ab582bc4a1 => generated 1511 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:00:37.101829 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-6f00c5ff-078c-42c2-ba71-57e075fc1ce6 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:37.102458 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-6f00c5ff-078c-42c2-ba71-57e075fc1ce6 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] [instance: fdf672c0-82ac-413b-a8cc-e01a4de45c4e] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:37.108626 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6f00c5ff-078c-42c2-ba71-57e075fc1ce6 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:37.109078 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6f00c5ff-078c-42c2-ba71-57e075fc1ce6 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:37.109846 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6f00c5ff-078c-42c2-ba71-57e075fc1ce6 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:37.110282 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6f00c5ff-078c-42c2-ba71-57e075fc1ce6 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:37.225867 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-20a8a673-1efd-41a5-93b9-7bf51d0f8f29 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:37.226725 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-20a8a673-1efd-41a5-93b9-7bf51d0f8f29 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: 22fe5ad8-01f8-4d0a-bb24-7c23a427d328] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:37.234244 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-20a8a673-1efd-41a5-93b9-7bf51d0f8f29 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:37.235084 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-20a8a673-1efd-41a5-93b9-7bf51d0f8f29 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:37.235936 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-20a8a673-1efd-41a5-93b9-7bf51d0f8f29 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:37.236388 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-20a8a673-1efd-41a5-93b9-7bf51d0f8f29 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:37.242593 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-6f00c5ff-078c-42c2-ba71-57e075fc1ce6 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334f2d8d9d9a4f7a90586999398f8a40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a02f6df4ed4365b3ce1fa970f9cf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:37.250221 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-6f00c5ff-078c-42c2-ba71-57e075fc1ce6 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] 10.222.0.20 "GET /compute/v2.1/servers/fdf672c0-82ac-413b-a8cc-e01a4de45c4e" status: 200 len: 1318 microversion: 2.1 time: 0.152250 Jul 30 05:00:37.258973 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 189/350] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:37 2022] GET /compute/v2.1/servers/fdf672c0-82ac-413b-a8cc-e01a4de45c4e => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:00:37.307430 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-20a8a673-1efd-41a5-93b9-7bf51d0f8f29 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8abb58f9c274e568d2d0fe3d4df11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01500cb03c74d1082090cd1c1836169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:37.315343 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-20a8a673-1efd-41a5-93b9-7bf51d0f8f29 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/22fe5ad8-01f8-4d0a-bb24-7c23a427d328" status: 200 len: 1245 microversion: 2.1 time: 0.094537 Jul 30 05:00:37.316132 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 162/351] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:37 2022] GET /compute/v2.1/servers/22fe5ad8-01f8-4d0a-bb24-7c23a427d328 => generated 1245 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 05:00:37.345003 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-e2e5d956-2c15-41c6-b383-aeb1a44d678b tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:37.345619 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-e2e5d956-2c15-41c6-b383-aeb1a44d678b tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:37.352504 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e2e5d956-2c15-41c6-b383-aeb1a44d678b tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:37.352958 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e2e5d956-2c15-41c6-b383-aeb1a44d678b tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:37.353728 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e2e5d956-2c15-41c6-b383-aeb1a44d678b tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:37.354171 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e2e5d956-2c15-41c6-b383-aeb1a44d678b tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:37.448454 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-442af783-198c-4baa-9f4f-6795b496a4e5 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:37.449069 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-442af783-198c-4baa-9f4f-6795b496a4e5 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] [instance: 8df9803f-05b0-4d65-aada-31539d50706f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:37.455122 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-442af783-198c-4baa-9f4f-6795b496a4e5 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:37.456337 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-442af783-198c-4baa-9f4f-6795b496a4e5 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:37.457385 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-442af783-198c-4baa-9f4f-6795b496a4e5 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:37.457981 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-442af783-198c-4baa-9f4f-6795b496a4e5 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:37.501587 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-e2e5d956-2c15-41c6-b383-aeb1a44d678b tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:37.509813 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-e2e5d956-2c15-41c6-b383-aeb1a44d678b tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:37.511368 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-e2e5d956-2c15-41c6-b383-aeb1a44d678b tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:37.512538 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-e2e5d956-2c15-41c6-b383-aeb1a44d678b tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1723 microversion: 2.20 time: 0.171435 Jul 30 05:00:37.513097 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 190/352] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:00:37 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 05:00:37.517439 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-9bf418a3-23b4-4054-8041-46c22ad31ce4 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:37.518760 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-9bf418a3-23b4-4054-8041-46c22ad31ce4 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: cc0c06a0-156a-4cee-8ff7-92ab582bc4a1] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:37.524698 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9bf418a3-23b4-4054-8041-46c22ad31ce4 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:37.525149 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9bf418a3-23b4-4054-8041-46c22ad31ce4 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:37.525953 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9bf418a3-23b4-4054-8041-46c22ad31ce4 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:37.526359 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9bf418a3-23b4-4054-8041-46c22ad31ce4 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:37.526855 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-442af783-198c-4baa-9f4f-6795b496a4e5 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98e41589d15488380a43000a82c2b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f102af4a74e946caa9fefc7ad0ae148c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:37.535185 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-442af783-198c-4baa-9f4f-6795b496a4e5 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] 10.222.0.20 "GET /compute/v2.1/servers/8df9803f-05b0-4d65-aada-31539d50706f" status: 200 len: 1217 microversion: 2.1 time: 0.090694 Jul 30 05:00:37.535756 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 163/353] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:37 2022] GET /compute/v2.1/servers/8df9803f-05b0-4d65-aada-31539d50706f => generated 1217 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:00:37.655426 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-9bf418a3-23b4-4054-8041-46c22ad31ce4 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:37.663007 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-9bf418a3-23b4-4054-8041-46c22ad31ce4 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0c06a0-156a-4cee-8ff7-92ab582bc4a1" status: 200 len: 1511 microversion: 2.1 time: 0.148969 Jul 30 05:00:37.663573 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 191/354] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:37 2022] GET /compute/v2.1/servers/cc0c06a0-156a-4cee-8ff7-92ab582bc4a1 => generated 1511 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:00:38.279630 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-5f5d9c65-6afd-4956-81d7-0cfe01d7cbab tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:38.280195 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-5f5d9c65-6afd-4956-81d7-0cfe01d7cbab tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] [instance: fdf672c0-82ac-413b-a8cc-e01a4de45c4e] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:38.287494 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5f5d9c65-6afd-4956-81d7-0cfe01d7cbab tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:38.287945 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5f5d9c65-6afd-4956-81d7-0cfe01d7cbab tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:38.288717 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5f5d9c65-6afd-4956-81d7-0cfe01d7cbab tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:38.289159 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5f5d9c65-6afd-4956-81d7-0cfe01d7cbab tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:38.336130 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-d9901304-9dec-47d9-a3a8-a659e12ff3a9 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:38.336835 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-d9901304-9dec-47d9-a3a8-a659e12ff3a9 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: 22fe5ad8-01f8-4d0a-bb24-7c23a427d328] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:38.342865 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d9901304-9dec-47d9-a3a8-a659e12ff3a9 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:38.343381 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d9901304-9dec-47d9-a3a8-a659e12ff3a9 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:38.344238 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d9901304-9dec-47d9-a3a8-a659e12ff3a9 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:38.344740 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d9901304-9dec-47d9-a3a8-a659e12ff3a9 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:38.410174 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-d9901304-9dec-47d9-a3a8-a659e12ff3a9 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8abb58f9c274e568d2d0fe3d4df11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01500cb03c74d1082090cd1c1836169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:38.417730 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-d9901304-9dec-47d9-a3a8-a659e12ff3a9 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/22fe5ad8-01f8-4d0a-bb24-7c23a427d328" status: 200 len: 1245 microversion: 2.1 time: 0.085748 Jul 30 05:00:38.419214 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 192/355] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:38 2022] GET /compute/v2.1/servers/22fe5ad8-01f8-4d0a-bb24-7c23a427d328 => generated 1245 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 05:00:38.453989 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-5f5d9c65-6afd-4956-81d7-0cfe01d7cbab tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334f2d8d9d9a4f7a90586999398f8a40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a02f6df4ed4365b3ce1fa970f9cf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:38.462000 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-5f5d9c65-6afd-4956-81d7-0cfe01d7cbab tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] 10.222.0.20 "GET /compute/v2.1/servers/fdf672c0-82ac-413b-a8cc-e01a4de45c4e" status: 200 len: 1318 microversion: 2.1 time: 0.186538 Jul 30 05:00:38.462593 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 164/356] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:38 2022] GET /compute/v2.1/servers/fdf672c0-82ac-413b-a8cc-e01a4de45c4e => generated 1318 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:00:38.537715 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-aa4fd173-09e5-4f3b-a2ac-c08d57df7369 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:38.538328 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-aa4fd173-09e5-4f3b-a2ac-c08d57df7369 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:38.546388 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-aa4fd173-09e5-4f3b-a2ac-c08d57df7369 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:38.547055 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-aa4fd173-09e5-4f3b-a2ac-c08d57df7369 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:38.548444 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-aa4fd173-09e5-4f3b-a2ac-c08d57df7369 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:38.550214 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-aa4fd173-09e5-4f3b-a2ac-c08d57df7369 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:38.557208 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-bd4e3984-668f-4ba4-a033-e2bf309b4256 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:38.557832 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-bd4e3984-668f-4ba4-a033-e2bf309b4256 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] [instance: 8df9803f-05b0-4d65-aada-31539d50706f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:38.572434 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-bd4e3984-668f-4ba4-a033-e2bf309b4256 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:38.576027 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-bd4e3984-668f-4ba4-a033-e2bf309b4256 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:38.577130 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-bd4e3984-668f-4ba4-a033-e2bf309b4256 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:38.577739 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-bd4e3984-668f-4ba4-a033-e2bf309b4256 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:38.679024 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-bd4e3984-668f-4ba4-a033-e2bf309b4256 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98e41589d15488380a43000a82c2b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f102af4a74e946caa9fefc7ad0ae148c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:38.687187 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-bd4e3984-668f-4ba4-a033-e2bf309b4256 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] 10.222.0.20 "GET /compute/v2.1/servers/8df9803f-05b0-4d65-aada-31539d50706f" status: 200 len: 1209 microversion: 2.1 time: 0.134095 Jul 30 05:00:38.687968 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 165/357] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:38 2022] GET /compute/v2.1/servers/8df9803f-05b0-4d65-aada-31539d50706f => generated 1209 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 05:00:38.693692 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-aa4fd173-09e5-4f3b-a2ac-c08d57df7369 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:38.699556 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-e4f8a352-bc5b-473e-9ac7-8d87c72ee40b tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:38.700271 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-e4f8a352-bc5b-473e-9ac7-8d87c72ee40b tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: cc0c06a0-156a-4cee-8ff7-92ab582bc4a1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:38.702751 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-aa4fd173-09e5-4f3b-a2ac-c08d57df7369 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:38.704469 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-aa4fd173-09e5-4f3b-a2ac-c08d57df7369 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:38.705677 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-aa4fd173-09e5-4f3b-a2ac-c08d57df7369 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1723 microversion: 2.20 time: 0.172881 Jul 30 05:00:38.706776 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e4f8a352-bc5b-473e-9ac7-8d87c72ee40b tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:38.707288 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e4f8a352-bc5b-473e-9ac7-8d87c72ee40b tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:38.708140 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e4f8a352-bc5b-473e-9ac7-8d87c72ee40b tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:38.708630 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e4f8a352-bc5b-473e-9ac7-8d87c72ee40b tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:38.713848 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 193/358] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:00:38 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 05:00:38.847011 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-e4f8a352-bc5b-473e-9ac7-8d87c72ee40b tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:38.854601 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-e4f8a352-bc5b-473e-9ac7-8d87c72ee40b tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0c06a0-156a-4cee-8ff7-92ab582bc4a1" status: 200 len: 1517 microversion: 2.1 time: 0.159981 Jul 30 05:00:38.855166 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 166/359] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:38 2022] GET /compute/v2.1/servers/cc0c06a0-156a-4cee-8ff7-92ab582bc4a1 => generated 1517 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:00:39.441019 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-2ae6e570-b495-41a7-8ea1-4f208f2cc628 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:39.442376 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-2ae6e570-b495-41a7-8ea1-4f208f2cc628 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: 22fe5ad8-01f8-4d0a-bb24-7c23a427d328] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:39.452078 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2ae6e570-b495-41a7-8ea1-4f208f2cc628 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:39.452540 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2ae6e570-b495-41a7-8ea1-4f208f2cc628 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:39.453410 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2ae6e570-b495-41a7-8ea1-4f208f2cc628 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:39.453853 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2ae6e570-b495-41a7-8ea1-4f208f2cc628 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:39.483310 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-c82c5d7e-8e0a-4f8e-93fe-d5335bc87b9e tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:39.483914 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-c82c5d7e-8e0a-4f8e-93fe-d5335bc87b9e tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] [instance: fdf672c0-82ac-413b-a8cc-e01a4de45c4e] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:39.494700 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c82c5d7e-8e0a-4f8e-93fe-d5335bc87b9e tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:39.495237 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c82c5d7e-8e0a-4f8e-93fe-d5335bc87b9e tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:39.496029 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c82c5d7e-8e0a-4f8e-93fe-d5335bc87b9e tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:39.498231 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c82c5d7e-8e0a-4f8e-93fe-d5335bc87b9e tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:39.524858 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-2ae6e570-b495-41a7-8ea1-4f208f2cc628 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8abb58f9c274e568d2d0fe3d4df11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01500cb03c74d1082090cd1c1836169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:39.533495 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-2ae6e570-b495-41a7-8ea1-4f208f2cc628 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/22fe5ad8-01f8-4d0a-bb24-7c23a427d328" status: 200 len: 1293 microversion: 2.1 time: 0.097466 Jul 30 05:00:39.534978 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 194/360] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:39 2022] GET /compute/v2.1/servers/22fe5ad8-01f8-4d0a-bb24-7c23a427d328 => generated 1293 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:00:39.661638 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-c82c5d7e-8e0a-4f8e-93fe-d5335bc87b9e tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334f2d8d9d9a4f7a90586999398f8a40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a02f6df4ed4365b3ce1fa970f9cf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:39.665757 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell1:SELECT=100 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:00:39.670719 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-c82c5d7e-8e0a-4f8e-93fe-d5335bc87b9e tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] 10.222.0.20 "GET /compute/v2.1/servers/fdf672c0-82ac-413b-a8cc-e01a4de45c4e" status: 200 len: 1318 microversion: 2.1 time: 0.191211 Jul 30 05:00:39.671280 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 167/361] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:39 2022] GET /compute/v2.1/servers/fdf672c0-82ac-413b-a8cc-e01a4de45c4e => generated 1318 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 05:00:39.708320 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-e4911ca1-8193-4078-ad60-b20b43b18e13 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:39.708972 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-e4911ca1-8193-4078-ad60-b20b43b18e13 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] [instance: 8df9803f-05b0-4d65-aada-31539d50706f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:39.715870 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e4911ca1-8193-4078-ad60-b20b43b18e13 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:39.716371 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e4911ca1-8193-4078-ad60-b20b43b18e13 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:39.717279 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e4911ca1-8193-4078-ad60-b20b43b18e13 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:39.717894 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e4911ca1-8193-4078-ad60-b20b43b18e13 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:39.738465 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-2e3a2d87-e0e3-4b3c-9826-f196ffac8156 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:39.740288 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-2e3a2d87-e0e3-4b3c-9826-f196ffac8156 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:39.759300 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2e3a2d87-e0e3-4b3c-9826-f196ffac8156 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:39.764617 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2e3a2d87-e0e3-4b3c-9826-f196ffac8156 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:39.765480 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2e3a2d87-e0e3-4b3c-9826-f196ffac8156 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:39.766074 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2e3a2d87-e0e3-4b3c-9826-f196ffac8156 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:39.893337 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-e4911ca1-8193-4078-ad60-b20b43b18e13 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98e41589d15488380a43000a82c2b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f102af4a74e946caa9fefc7ad0ae148c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:39.903089 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-e4911ca1-8193-4078-ad60-b20b43b18e13 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] 10.222.0.20 "GET /compute/v2.1/servers/8df9803f-05b0-4d65-aada-31539d50706f" status: 200 len: 1273 microversion: 2.1 time: 0.199494 Jul 30 05:00:39.903659 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 195/362] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:39 2022] GET /compute/v2.1/servers/8df9803f-05b0-4d65-aada-31539d50706f => generated 1273 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:00:39.992655 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-d526e13c-b53e-4d6e-8936-a88af65b3f5b req-4efd7d04-9c2c-43af-bbdf-81f0813d6633 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdf672c0-82ac-413b-a8cc-e01a4de45c4e", "name": "network-vif-plugged", "status": "completed", "tag": "489c2188-4f11-4296-9de5-6a7a8bb1a9dd"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:00:40.027686 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-d526e13c-b53e-4d6e-8936-a88af65b3f5b req-4efd7d04-9c2c-43af-bbdf-81f0813d6633 service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:40.028139 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-d526e13c-b53e-4d6e-8936-a88af65b3f5b req-4efd7d04-9c2c-43af-bbdf-81f0813d6633 service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:40.050230 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-d526e13c-b53e-4d6e-8936-a88af65b3f5b req-4efd7d04-9c2c-43af-bbdf-81f0813d6633 service nova] Creating event network-vif-plugged:489c2188-4f11-4296-9de5-6a7a8bb1a9dd for instance fdf672c0-82ac-413b-a8cc-e01a4de45c4e on hv-cinder-85127 Jul 30 05:00:40.066964 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-2e3a2d87-e0e3-4b3c-9826-f196ffac8156 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:40.077681 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-d526e13c-b53e-4d6e-8936-a88af65b3f5b req-4efd7d04-9c2c-43af-bbdf-81f0813d6633 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088751 Jul 30 05:00:40.079126 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 196/363] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Jul 30 05:00:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 05:00:40.079671 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-2e3a2d87-e0e3-4b3c-9826-f196ffac8156 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:40.081756 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-2e3a2d87-e0e3-4b3c-9826-f196ffac8156 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:40.083289 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-2e3a2d87-e0e3-4b3c-9826-f196ffac8156 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1723 microversion: 2.20 time: 0.357176 Jul 30 05:00:40.084472 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 168/364] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:00:39 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1723 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 05:00:40.557692 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-6cfca308-d123-4470-afe8-cebe64376952 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:40.560027 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-6cfca308-d123-4470-afe8-cebe64376952 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: 22fe5ad8-01f8-4d0a-bb24-7c23a427d328] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:40.568036 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6cfca308-d123-4470-afe8-cebe64376952 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:40.568843 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6cfca308-d123-4470-afe8-cebe64376952 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:40.569656 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6cfca308-d123-4470-afe8-cebe64376952 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:40.570092 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6cfca308-d123-4470-afe8-cebe64376952 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:40.653942 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-6cfca308-d123-4470-afe8-cebe64376952 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8abb58f9c274e568d2d0fe3d4df11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01500cb03c74d1082090cd1c1836169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:40.663368 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-6cfca308-d123-4470-afe8-cebe64376952 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/22fe5ad8-01f8-4d0a-bb24-7c23a427d328" status: 200 len: 1299 microversion: 2.1 time: 0.110345 Jul 30 05:00:40.663943 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 197/365] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:40 2022] GET /compute/v2.1/servers/22fe5ad8-01f8-4d0a-bb24-7c23a427d328 => generated 1299 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:00:40.692240 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-83844598-c068-4350-baac-64856f4f9aae tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:40.693427 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-83844598-c068-4350-baac-64856f4f9aae tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] [instance: fdf672c0-82ac-413b-a8cc-e01a4de45c4e] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:40.700514 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-83844598-c068-4350-baac-64856f4f9aae tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:40.700973 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-83844598-c068-4350-baac-64856f4f9aae tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:40.701754 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-83844598-c068-4350-baac-64856f4f9aae tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:40.702429 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-83844598-c068-4350-baac-64856f4f9aae tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:40.925150 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-4f689676-85f2-4dba-9f8e-a6173acfb315 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:40.926116 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-4f689676-85f2-4dba-9f8e-a6173acfb315 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] [instance: 8df9803f-05b0-4d65-aada-31539d50706f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:40.932786 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4f689676-85f2-4dba-9f8e-a6173acfb315 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:40.933319 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4f689676-85f2-4dba-9f8e-a6173acfb315 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:40.934202 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4f689676-85f2-4dba-9f8e-a6173acfb315 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:40.935144 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4f689676-85f2-4dba-9f8e-a6173acfb315 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:40.943068 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-83844598-c068-4350-baac-64856f4f9aae tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334f2d8d9d9a4f7a90586999398f8a40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a02f6df4ed4365b3ce1fa970f9cf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:40.960253 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-83844598-c068-4350-baac-64856f4f9aae tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] 10.222.0.20 "GET /compute/v2.1/servers/fdf672c0-82ac-413b-a8cc-e01a4de45c4e" status: 200 len: 1318 microversion: 2.1 time: 0.271390 Jul 30 05:00:40.961169 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 169/366] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:40 2022] GET /compute/v2.1/servers/fdf672c0-82ac-413b-a8cc-e01a4de45c4e => generated 1318 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:00:41.108210 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-0f0ba34d-1751-4427-80bb-b922ba9fcef7 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:41.108821 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-0f0ba34d-1751-4427-80bb-b922ba9fcef7 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:41.116065 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0f0ba34d-1751-4427-80bb-b922ba9fcef7 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:41.116701 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0f0ba34d-1751-4427-80bb-b922ba9fcef7 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:41.117676 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0f0ba34d-1751-4427-80bb-b922ba9fcef7 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:41.118270 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0f0ba34d-1751-4427-80bb-b922ba9fcef7 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:41.211081 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-4f689676-85f2-4dba-9f8e-a6173acfb315 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98e41589d15488380a43000a82c2b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f102af4a74e946caa9fefc7ad0ae148c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:41.223962 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-4f689676-85f2-4dba-9f8e-a6173acfb315 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] 10.222.0.20 "GET /compute/v2.1/servers/8df9803f-05b0-4d65-aada-31539d50706f" status: 200 len: 1313 microversion: 2.1 time: 0.302934 Jul 30 05:00:41.224738 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 198/367] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:40 2022] GET /compute/v2.1/servers/8df9803f-05b0-4d65-aada-31539d50706f => generated 1313 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 05:00:41.360832 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-0f0ba34d-1751-4427-80bb-b922ba9fcef7 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:41.373870 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-0f0ba34d-1751-4427-80bb-b922ba9fcef7 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:41.376170 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-0f0ba34d-1751-4427-80bb-b922ba9fcef7 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:41.377278 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-0f0ba34d-1751-4427-80bb-b922ba9fcef7 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1723 microversion: 2.20 time: 0.273125 Jul 30 05:00:41.394468 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 170/368] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:00:41 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1723 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 05:00:41.402384 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-d52d7be9-3e46-4423-9316-3e1b653e1e47 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Action: 'create', calling method: .version_select at 0x7f2db42f7940>, body: {"keypair": {"name": "tempest-keypair-959895067", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJdelLwueMyOfycx5c6RmGcuWrVac2WdtQ5gB+CsHOdro5zXzI55QllrE7IODRJxtplY/ZIVOEZ0RCmWLebtO9xU7/MAAA+GXTO2IioVZlOHFMcI265OErSVWHwnXJjycw=="}} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:00:41.421193 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.quota [None req-d52d7be9-3e46-4423-9316-3e1b653e1e47 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Getting quotas for project decb0bd64582440590890900e594b79e. Resources: {'key_pairs'} {{(pid=117886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 05:00:41.428366 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.quota [None req-d52d7be9-3e46-4423-9316-3e1b653e1e47 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Getting quotas for user 25db6f7402ae4a14a04fab0a9915ab77 and project decb0bd64582440590890900e594b79e. Resources: {'key_pairs'} {{(pid=117886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 05:00:41.468766 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-d52d7be9-3e46-4423-9316-3e1b653e1e47 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.069909 Jul 30 05:00:41.469398 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 199/369] 10.222.0.20 () {60 vars in 1159 bytes} [Sat Jul 30 05:00:41 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 05:00:41.687074 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-fd89f843-ae62-4d8e-8bae-dc9c9b0fbb20 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:41.687864 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-fd89f843-ae62-4d8e-8bae-dc9c9b0fbb20 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: 22fe5ad8-01f8-4d0a-bb24-7c23a427d328] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:41.710762 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-70c67b92-bbf7-4fd0-8bb7-7b52ed404ff6 req-904c085c-24c9-40c8-8fce-531e3daae03a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8df9803f-05b0-4d65-aada-31539d50706f", "tag": "c9566a0a-7940-4373-8c65-d96596348430"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:00:41.711946 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-fd89f843-ae62-4d8e-8bae-dc9c9b0fbb20 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:41.713697 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-fd89f843-ae62-4d8e-8bae-dc9c9b0fbb20 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:41.715078 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-fd89f843-ae62-4d8e-8bae-dc9c9b0fbb20 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:41.715783 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-fd89f843-ae62-4d8e-8bae-dc9c9b0fbb20 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:41.734578 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-70c67b92-bbf7-4fd0-8bb7-7b52ed404ff6 req-904c085c-24c9-40c8-8fce-531e3daae03a service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:41.735442 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-70c67b92-bbf7-4fd0-8bb7-7b52ed404ff6 req-904c085c-24c9-40c8-8fce-531e3daae03a service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:41.759608 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-70c67b92-bbf7-4fd0-8bb7-7b52ed404ff6 req-904c085c-24c9-40c8-8fce-531e3daae03a service nova] Creating event network-changed:c9566a0a-7940-4373-8c65-d96596348430 for instance 8df9803f-05b0-4d65-aada-31539d50706f on hv-cinder-85127 Jul 30 05:00:41.765183 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-70c67b92-bbf7-4fd0-8bb7-7b52ed404ff6 req-904c085c-24c9-40c8-8fce-531e3daae03a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059255 Jul 30 05:00:41.766464 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 200/370] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Jul 30 05:00:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 05:00:41.984597 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-a321e6d3-bad3-4b5b-a482-d64c1f575058 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:41.985294 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-a321e6d3-bad3-4b5b-a482-d64c1f575058 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] [instance: fdf672c0-82ac-413b-a8cc-e01a4de45c4e] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:41.992286 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a321e6d3-bad3-4b5b-a482-d64c1f575058 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:41.992747 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a321e6d3-bad3-4b5b-a482-d64c1f575058 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:41.993500 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a321e6d3-bad3-4b5b-a482-d64c1f575058 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:41.993931 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a321e6d3-bad3-4b5b-a482-d64c1f575058 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:42.010865 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-fd89f843-ae62-4d8e-8bae-dc9c9b0fbb20 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8abb58f9c274e568d2d0fe3d4df11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01500cb03c74d1082090cd1c1836169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:42.028168 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-fd89f843-ae62-4d8e-8bae-dc9c9b0fbb20 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/22fe5ad8-01f8-4d0a-bb24-7c23a427d328" status: 200 len: 1367 microversion: 2.1 time: 0.346085 Jul 30 05:00:42.038468 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 171/371] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:41 2022] GET /compute/v2.1/servers/22fe5ad8-01f8-4d0a-bb24-7c23a427d328 => generated 1367 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 05:00:42.139821 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-a321e6d3-bad3-4b5b-a482-d64c1f575058 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334f2d8d9d9a4f7a90586999398f8a40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a02f6df4ed4365b3ce1fa970f9cf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:42.147763 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-a321e6d3-bad3-4b5b-a482-d64c1f575058 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] 10.222.0.20 "GET /compute/v2.1/servers/fdf672c0-82ac-413b-a8cc-e01a4de45c4e" status: 200 len: 1506 microversion: 2.1 time: 0.167331 Jul 30 05:00:42.148334 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 201/372] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:41 2022] GET /compute/v2.1/servers/fdf672c0-82ac-413b-a8cc-e01a4de45c4e => generated 1506 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:00:42.246108 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-f13ff80f-a706-4a59-8bb6-5bb8280e0025 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:42.247076 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-f13ff80f-a706-4a59-8bb6-5bb8280e0025 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] [instance: 8df9803f-05b0-4d65-aada-31539d50706f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:42.256571 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f13ff80f-a706-4a59-8bb6-5bb8280e0025 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:42.257767 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f13ff80f-a706-4a59-8bb6-5bb8280e0025 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:42.259153 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f13ff80f-a706-4a59-8bb6-5bb8280e0025 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:42.259829 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f13ff80f-a706-4a59-8bb6-5bb8280e0025 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:42.386621 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-6e0c8edb-5794-4f59-b647-f19f5794269a req-0a43dcf7-f763-4a40-beb4-71327d6f896d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22fe5ad8-01f8-4d0a-bb24-7c23a427d328", "tag": "067511f8-7ca6-4d74-8168-37c6673684c1"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:00:42.421919 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-6e0c8edb-5794-4f59-b647-f19f5794269a req-0a43dcf7-f763-4a40-beb4-71327d6f896d service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:42.422714 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-6e0c8edb-5794-4f59-b647-f19f5794269a req-0a43dcf7-f763-4a40-beb4-71327d6f896d service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:42.438253 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-6e0c8edb-5794-4f59-b647-f19f5794269a req-0a43dcf7-f763-4a40-beb4-71327d6f896d service nova] Creating event network-changed:067511f8-7ca6-4d74-8168-37c6673684c1 for instance 22fe5ad8-01f8-4d0a-bb24-7c23a427d328 on hv-cinder-85127 Jul 30 05:00:42.445114 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-6e0c8edb-5794-4f59-b647-f19f5794269a req-0a43dcf7-f763-4a40-beb4-71327d6f896d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071723 Jul 30 05:00:42.446388 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 202/373] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Jul 30 05:00:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 05:00:42.452732 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-1db21bc2-9b24-46a9-bf6c-519af07a46df tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:42.453599 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-1db21bc2-9b24-46a9-bf6c-519af07a46df tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:42.462524 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1db21bc2-9b24-46a9-bf6c-519af07a46df tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:42.463153 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1db21bc2-9b24-46a9-bf6c-519af07a46df tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:42.464112 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1db21bc2-9b24-46a9-bf6c-519af07a46df tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:42.464699 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1db21bc2-9b24-46a9-bf6c-519af07a46df tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:42.530300 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-f13ff80f-a706-4a59-8bb6-5bb8280e0025 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98e41589d15488380a43000a82c2b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f102af4a74e946caa9fefc7ad0ae148c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:42.537820 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-f13ff80f-a706-4a59-8bb6-5bb8280e0025 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] 10.222.0.20 "GET /compute/v2.1/servers/8df9803f-05b0-4d65-aada-31539d50706f" status: 200 len: 1313 microversion: 2.1 time: 0.296425 Jul 30 05:00:42.538388 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 172/374] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:42 2022] GET /compute/v2.1/servers/8df9803f-05b0-4d65-aada-31539d50706f => generated 1313 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:00:42.796328 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-1db21bc2-9b24-46a9-bf6c-519af07a46df tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:42.811695 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-1db21bc2-9b24-46a9-bf6c-519af07a46df tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:42.817132 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-1db21bc2-9b24-46a9-bf6c-519af07a46df tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:42.819940 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-1db21bc2-9b24-46a9-bf6c-519af07a46df tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1723 microversion: 2.20 time: 0.372262 Jul 30 05:00:42.821214 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 203/375] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:00:42 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1723 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 05:00:43.051676 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-5d756bab-f09a-4383-b65f-52f2dc339c9a tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:43.052902 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-5d756bab-f09a-4383-b65f-52f2dc339c9a tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: 22fe5ad8-01f8-4d0a-bb24-7c23a427d328] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:43.059616 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:00:43.062001 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5d756bab-f09a-4383-b65f-52f2dc339c9a tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:43.062648 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5d756bab-f09a-4383-b65f-52f2dc339c9a tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:43.063617 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5d756bab-f09a-4383-b65f-52f2dc339c9a tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:43.064213 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5d756bab-f09a-4383-b65f-52f2dc339c9a tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:43.300238 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-5d756bab-f09a-4383-b65f-52f2dc339c9a tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8abb58f9c274e568d2d0fe3d4df11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01500cb03c74d1082090cd1c1836169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:43.308002 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-5d756bab-f09a-4383-b65f-52f2dc339c9a tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/22fe5ad8-01f8-4d0a-bb24-7c23a427d328" status: 200 len: 1367 microversion: 2.1 time: 0.261192 Jul 30 05:00:43.308574 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 173/376] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:43 2022] GET /compute/v2.1/servers/22fe5ad8-01f8-4d0a-bb24-7c23a427d328 => generated 1367 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:00:43.559546 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-d9af14a0-e9f1-47a3-b443-d9ee9f4d278f tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:43.560932 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-d9af14a0-e9f1-47a3-b443-d9ee9f4d278f tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] [instance: 8df9803f-05b0-4d65-aada-31539d50706f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:43.567527 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d9af14a0-e9f1-47a3-b443-d9ee9f4d278f tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:43.568069 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d9af14a0-e9f1-47a3-b443-d9ee9f4d278f tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:43.568851 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d9af14a0-e9f1-47a3-b443-d9ee9f4d278f tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:43.569281 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d9af14a0-e9f1-47a3-b443-d9ee9f4d278f tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:43.847813 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-f44abda6-9109-47e8-a6b6-ee81ef5b0e8c tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:43.848558 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-f44abda6-9109-47e8-a6b6-ee81ef5b0e8c tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:43.861609 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f44abda6-9109-47e8-a6b6-ee81ef5b0e8c tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:43.862887 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f44abda6-9109-47e8-a6b6-ee81ef5b0e8c tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:43.863914 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f44abda6-9109-47e8-a6b6-ee81ef5b0e8c tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:43.864550 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f44abda6-9109-47e8-a6b6-ee81ef5b0e8c tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:43.886137 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-d9af14a0-e9f1-47a3-b443-d9ee9f4d278f tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98e41589d15488380a43000a82c2b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f102af4a74e946caa9fefc7ad0ae148c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:43.906414 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-d9af14a0-e9f1-47a3-b443-d9ee9f4d278f tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] 10.222.0.20 "GET /compute/v2.1/servers/8df9803f-05b0-4d65-aada-31539d50706f" status: 200 len: 1313 microversion: 2.1 time: 0.350645 Jul 30 05:00:43.912557 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 204/377] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:43 2022] GET /compute/v2.1/servers/8df9803f-05b0-4d65-aada-31539d50706f => generated 1313 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:00:44.021866 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-f44abda6-9109-47e8-a6b6-ee81ef5b0e8c tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:44.032035 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-f44abda6-9109-47e8-a6b6-ee81ef5b0e8c tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:44.033731 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-f44abda6-9109-47e8-a6b6-ee81ef5b0e8c tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:44.035679 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-f44abda6-9109-47e8-a6b6-ee81ef5b0e8c tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1723 microversion: 2.20 time: 0.194443 Jul 30 05:00:44.036457 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 174/378] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:00:43 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1723 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 05:00:44.180472 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-98ecc67b-a01d-4744-95df-1ad50fddeec2 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-475217903", "imageRef": "d6a9c8e1-ecb9-4603-bb88-2b0d46ac2387", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cf976b2f-0ebc-4e5a-b101-0355f31913b1"}], "security_groups": [{"name": "tempest-securitygroup--515089038"}], "key_name": "tempest-keypair-959895067", "user_data": "}} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:00:44.315135 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.network.neutron [None req-98ecc67b-a01d-4744-95df-1ad50fddeec2 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] validate_networks() for [('cf976b2f-0ebc-4e5a-b101-0355f31913b1', None, None, None, None, None)] {{(pid=117886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 05:00:44.328590 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-f2c7a470-4f89-4c0f-ac2f-f33cce1f1fa8 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:44.329203 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-f2c7a470-4f89-4c0f-ac2f-f33cce1f1fa8 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: 22fe5ad8-01f8-4d0a-bb24-7c23a427d328] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:44.337231 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f2c7a470-4f89-4c0f-ac2f-f33cce1f1fa8 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:44.337757 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f2c7a470-4f89-4c0f-ac2f-f33cce1f1fa8 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:44.338897 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f2c7a470-4f89-4c0f-ac2f-f33cce1f1fa8 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:44.339650 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f2c7a470-4f89-4c0f-ac2f-f33cce1f1fa8 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:44.549834 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-f2c7a470-4f89-4c0f-ac2f-f33cce1f1fa8 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8abb58f9c274e568d2d0fe3d4df11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01500cb03c74d1082090cd1c1836169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:44.557802 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-f2c7a470-4f89-4c0f-ac2f-f33cce1f1fa8 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/22fe5ad8-01f8-4d0a-bb24-7c23a427d328" status: 200 len: 1367 microversion: 2.1 time: 0.233031 Jul 30 05:00:44.558378 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 175/379] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:44 2022] GET /compute/v2.1/servers/22fe5ad8-01f8-4d0a-bb24-7c23a427d328 => generated 1367 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 05:00:44.745029 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-98ecc67b-a01d-4744-95df-1ad50fddeec2 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Flavor limits 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 05:00:44.745524 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-98ecc67b-a01d-4744-95df-1ad50fddeec2 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Image limits 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 05:00:44.746072 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-98ecc67b-a01d-4744-95df-1ad50fddeec2 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Flavor pref 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 05:00:44.746611 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-98ecc67b-a01d-4744-95df-1ad50fddeec2 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Image pref 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 05:00:44.747129 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-98ecc67b-a01d-4744-95df-1ad50fddeec2 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 05:00:44.756216 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-98ecc67b-a01d-4744-95df-1ad50fddeec2 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:44.756668 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-98ecc67b-a01d-4744-95df-1ad50fddeec2 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:44.757465 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-98ecc67b-a01d-4744-95df-1ad50fddeec2 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:44.757901 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-98ecc67b-a01d-4744-95df-1ad50fddeec2 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:44.774985 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.quota [None req-98ecc67b-a01d-4744-95df-1ad50fddeec2 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Getting quotas for project decb0bd64582440590890900e594b79e. Resources: {'ram', 'cores', 'instances'} {{(pid=117886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 05:00:44.778998 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.quota [None req-98ecc67b-a01d-4744-95df-1ad50fddeec2 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Getting quotas for user 25db6f7402ae4a14a04fab0a9915ab77 and project decb0bd64582440590890900e594b79e. Resources: {'ram', 'cores', 'instances'} {{(pid=117886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 05:00:44.791509 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-98ecc67b-a01d-4744-95df-1ad50fddeec2 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Going to run 1 instances... {{(pid=117886) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 05:00:44.794143 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-98ecc67b-a01d-4744-95df-1ad50fddeec2 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 65b7a5ff-be03-4f45-941c-26a50cdabf02] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d6a9c8e1-ecb9-4603-bb88-2b0d46ac2387',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 05:00:44.854395 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-98ecc67b-a01d-4744-95df-1ad50fddeec2 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.685603 Jul 30 05:00:44.855090 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 205/380] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Jul 30 05:00:44 2022] POST /compute/v2.1/servers => generated 408 bytes in 687 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 05:00:44.866624 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-e653b884-4ac2-4c41-ba25-98fed274b463 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:44.867719 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-e653b884-4ac2-4c41-ba25-98fed274b463 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 65b7a5ff-be03-4f45-941c-26a50cdabf02] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:44.930016 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-e653b884-4ac2-4c41-ba25-98fed274b463 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:44.933392 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-7f3faacc-c166-40a6-b4af-3083b5db9a45 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:44.934128 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-7f3faacc-c166-40a6-b4af-3083b5db9a45 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] [instance: 8df9803f-05b0-4d65-aada-31539d50706f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:44.945086 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-e653b884-4ac2-4c41-ba25-98fed274b463 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/65b7a5ff-be03-4f45-941c-26a50cdabf02" status: 200 len: 1244 microversion: 2.1 time: 0.083137 Jul 30 05:00:44.948467 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 176/381] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:44 2022] GET /compute/v2.1/servers/65b7a5ff-be03-4f45-941c-26a50cdabf02 => generated 1244 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:00:44.950335 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7f3faacc-c166-40a6-b4af-3083b5db9a45 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:44.951112 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7f3faacc-c166-40a6-b4af-3083b5db9a45 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:44.952255 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7f3faacc-c166-40a6-b4af-3083b5db9a45 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:44.952813 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7f3faacc-c166-40a6-b4af-3083b5db9a45 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:45.069701 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-26fded88-547f-4398-9584-125bf9426a27 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:45.070320 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-26fded88-547f-4398-9584-125bf9426a27 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:45.082645 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-26fded88-547f-4398-9584-125bf9426a27 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:45.083100 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-26fded88-547f-4398-9584-125bf9426a27 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:45.084119 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-26fded88-547f-4398-9584-125bf9426a27 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:45.084724 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-26fded88-547f-4398-9584-125bf9426a27 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:45.133587 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-7f3faacc-c166-40a6-b4af-3083b5db9a45 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98e41589d15488380a43000a82c2b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f102af4a74e946caa9fefc7ad0ae148c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:45.141654 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-7f3faacc-c166-40a6-b4af-3083b5db9a45 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] 10.222.0.20 "GET /compute/v2.1/servers/8df9803f-05b0-4d65-aada-31539d50706f" status: 200 len: 1313 microversion: 2.1 time: 0.214643 Jul 30 05:00:45.143756 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 206/382] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:44 2022] GET /compute/v2.1/servers/8df9803f-05b0-4d65-aada-31539d50706f => generated 1313 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:00:45.248434 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-26fded88-547f-4398-9584-125bf9426a27 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:45.257520 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-26fded88-547f-4398-9584-125bf9426a27 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:45.260064 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-26fded88-547f-4398-9584-125bf9426a27 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:45.261560 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-26fded88-547f-4398-9584-125bf9426a27 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1723 microversion: 2.20 time: 0.196448 Jul 30 05:00:45.262589 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 177/383] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:00:45 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1723 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 05:00:45.579276 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-cb772a09-edf2-4ebf-8f45-ec87b725d6ef tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:45.580091 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-cb772a09-edf2-4ebf-8f45-ec87b725d6ef tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: 22fe5ad8-01f8-4d0a-bb24-7c23a427d328] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:45.588243 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cb772a09-edf2-4ebf-8f45-ec87b725d6ef tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:45.590741 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cb772a09-edf2-4ebf-8f45-ec87b725d6ef tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:45.592057 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cb772a09-edf2-4ebf-8f45-ec87b725d6ef tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:45.592646 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cb772a09-edf2-4ebf-8f45-ec87b725d6ef tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:45.832074 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-cb772a09-edf2-4ebf-8f45-ec87b725d6ef tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8abb58f9c274e568d2d0fe3d4df11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01500cb03c74d1082090cd1c1836169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:45.841208 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-cb772a09-edf2-4ebf-8f45-ec87b725d6ef tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/22fe5ad8-01f8-4d0a-bb24-7c23a427d328" status: 200 len: 1367 microversion: 2.1 time: 0.265639 Jul 30 05:00:45.842293 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 207/384] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:45 2022] GET /compute/v2.1/servers/22fe5ad8-01f8-4d0a-bb24-7c23a427d328 => generated 1367 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:00:45.979984 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-4789d1c1-d972-40e8-a04a-89d1a6554156 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:45.980568 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-4789d1c1-d972-40e8-a04a-89d1a6554156 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 65b7a5ff-be03-4f45-941c-26a50cdabf02] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:45.992411 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell0:SELECT=2 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:00:45.999390 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4789d1c1-d972-40e8-a04a-89d1a6554156 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:46.000151 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4789d1c1-d972-40e8-a04a-89d1a6554156 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:46.001850 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4789d1c1-d972-40e8-a04a-89d1a6554156 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:46.002714 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4789d1c1-d972-40e8-a04a-89d1a6554156 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:46.132907 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-4789d1c1-d972-40e8-a04a-89d1a6554156 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:46.140494 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-4789d1c1-d972-40e8-a04a-89d1a6554156 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/65b7a5ff-be03-4f45-941c-26a50cdabf02" status: 200 len: 1296 microversion: 2.1 time: 0.164844 Jul 30 05:00:46.141197 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 178/385] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:45 2022] GET /compute/v2.1/servers/65b7a5ff-be03-4f45-941c-26a50cdabf02 => generated 1296 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:00:46.168218 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-4fb379ba-51e9-4d5a-9758-31c1a7cb2be9 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:46.169579 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-4fb379ba-51e9-4d5a-9758-31c1a7cb2be9 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] [instance: 8df9803f-05b0-4d65-aada-31539d50706f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:46.185141 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4fb379ba-51e9-4d5a-9758-31c1a7cb2be9 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:46.185585 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4fb379ba-51e9-4d5a-9758-31c1a7cb2be9 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:46.186686 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4fb379ba-51e9-4d5a-9758-31c1a7cb2be9 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:46.187129 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4fb379ba-51e9-4d5a-9758-31c1a7cb2be9 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:46.192133 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=100 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:00:46.289911 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-406f270b-3703-4c89-b818-b5d10066991a tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:46.291441 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-406f270b-3703-4c89-b818-b5d10066991a tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:46.311245 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-406f270b-3703-4c89-b818-b5d10066991a tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:46.313860 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-406f270b-3703-4c89-b818-b5d10066991a tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:46.316146 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-406f270b-3703-4c89-b818-b5d10066991a tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:46.317332 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-406f270b-3703-4c89-b818-b5d10066991a tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:46.438024 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-4fb379ba-51e9-4d5a-9758-31c1a7cb2be9 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98e41589d15488380a43000a82c2b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f102af4a74e946caa9fefc7ad0ae148c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:46.449969 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-4fb379ba-51e9-4d5a-9758-31c1a7cb2be9 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] 10.222.0.20 "GET /compute/v2.1/servers/8df9803f-05b0-4d65-aada-31539d50706f" status: 200 len: 1313 microversion: 2.1 time: 0.288890 Jul 30 05:00:46.450950 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 208/386] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:46 2022] GET /compute/v2.1/servers/8df9803f-05b0-4d65-aada-31539d50706f => generated 1313 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:00:46.767053 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-406f270b-3703-4c89-b818-b5d10066991a tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:46.775820 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-406f270b-3703-4c89-b818-b5d10066991a tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:46.777532 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-406f270b-3703-4c89-b818-b5d10066991a tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:46.778737 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-406f270b-3703-4c89-b818-b5d10066991a tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1744 microversion: 2.20 time: 0.496715 Jul 30 05:00:46.779289 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 179/387] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:00:46 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1744 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 05:00:46.863935 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-469d1547-6c55-4035-9a3a-c6d339a76ebe tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:46.864554 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-469d1547-6c55-4035-9a3a-c6d339a76ebe tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: 22fe5ad8-01f8-4d0a-bb24-7c23a427d328] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:46.876133 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-469d1547-6c55-4035-9a3a-c6d339a76ebe tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:46.876584 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-469d1547-6c55-4035-9a3a-c6d339a76ebe tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:46.877424 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-469d1547-6c55-4035-9a3a-c6d339a76ebe tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:46.877856 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-469d1547-6c55-4035-9a3a-c6d339a76ebe tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:47.165385 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-9f197b80-6794-40bd-9015-c6b7166ca89c tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:47.166617 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-9f197b80-6794-40bd-9015-c6b7166ca89c tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 65b7a5ff-be03-4f45-941c-26a50cdabf02] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:47.173589 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9f197b80-6794-40bd-9015-c6b7166ca89c tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:47.174408 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9f197b80-6794-40bd-9015-c6b7166ca89c tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:47.175507 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9f197b80-6794-40bd-9015-c6b7166ca89c tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:47.176120 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9f197b80-6794-40bd-9015-c6b7166ca89c tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:47.253928 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-469d1547-6c55-4035-9a3a-c6d339a76ebe tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8abb58f9c274e568d2d0fe3d4df11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01500cb03c74d1082090cd1c1836169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:47.271425 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-469d1547-6c55-4035-9a3a-c6d339a76ebe tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/22fe5ad8-01f8-4d0a-bb24-7c23a427d328" status: 200 len: 1367 microversion: 2.1 time: 0.412079 Jul 30 05:00:47.273740 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-9f197b80-6794-40bd-9015-c6b7166ca89c tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:47.274548 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 209/388] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:46 2022] GET /compute/v2.1/servers/22fe5ad8-01f8-4d0a-bb24-7c23a427d328 => generated 1367 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:00:47.285020 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-9f197b80-6794-40bd-9015-c6b7166ca89c tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/65b7a5ff-be03-4f45-941c-26a50cdabf02" status: 200 len: 1302 microversion: 2.1 time: 0.123372 Jul 30 05:00:47.299005 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 180/389] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:47 2022] GET /compute/v2.1/servers/65b7a5ff-be03-4f45-941c-26a50cdabf02 => generated 1302 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:00:47.476256 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-c72b7d69-208b-4322-9524-143e3c33494d tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:47.477084 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-c72b7d69-208b-4322-9524-143e3c33494d tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] [instance: 8df9803f-05b0-4d65-aada-31539d50706f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:47.485807 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c72b7d69-208b-4322-9524-143e3c33494d tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:47.486735 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c72b7d69-208b-4322-9524-143e3c33494d tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:47.487956 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c72b7d69-208b-4322-9524-143e3c33494d tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:47.488592 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c72b7d69-208b-4322-9524-143e3c33494d tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:47.718718 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-c72b7d69-208b-4322-9524-143e3c33494d tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98e41589d15488380a43000a82c2b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f102af4a74e946caa9fefc7ad0ae148c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:47.731760 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-c72b7d69-208b-4322-9524-143e3c33494d tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] 10.222.0.20 "GET /compute/v2.1/servers/8df9803f-05b0-4d65-aada-31539d50706f" status: 200 len: 1313 microversion: 2.1 time: 0.262655 Jul 30 05:00:47.735384 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 210/390] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:47 2022] GET /compute/v2.1/servers/8df9803f-05b0-4d65-aada-31539d50706f => generated 1313 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:00:47.811267 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-ece2314b-1fcb-431f-b586-935dfb7ad25f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:47.812336 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-ece2314b-1fcb-431f-b586-935dfb7ad25f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:47.823753 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ece2314b-1fcb-431f-b586-935dfb7ad25f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:47.824214 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ece2314b-1fcb-431f-b586-935dfb7ad25f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:47.834942 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ece2314b-1fcb-431f-b586-935dfb7ad25f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:47.835518 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ece2314b-1fcb-431f-b586-935dfb7ad25f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:48.227268 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-ece2314b-1fcb-431f-b586-935dfb7ad25f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:48.239325 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-ece2314b-1fcb-431f-b586-935dfb7ad25f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:48.248000 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-ece2314b-1fcb-431f-b586-935dfb7ad25f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:48.250311 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-ece2314b-1fcb-431f-b586-935dfb7ad25f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1744 microversion: 2.20 time: 0.448341 Jul 30 05:00:48.253853 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 181/391] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:00:47 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1744 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 05:00:48.300466 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-07e58ef7-ad53-4d52-8a69-68f8585e53a3 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:48.302073 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-07e58ef7-ad53-4d52-8a69-68f8585e53a3 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: 22fe5ad8-01f8-4d0a-bb24-7c23a427d328] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:48.307436 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-5666f1e9-bb26-40c4-8417-d4b217c01c60 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:48.308044 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-5666f1e9-bb26-40c4-8417-d4b217c01c60 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 65b7a5ff-be03-4f45-941c-26a50cdabf02] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:48.318375 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5666f1e9-bb26-40c4-8417-d4b217c01c60 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:48.320979 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5666f1e9-bb26-40c4-8417-d4b217c01c60 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:48.322295 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5666f1e9-bb26-40c4-8417-d4b217c01c60 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:48.323459 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5666f1e9-bb26-40c4-8417-d4b217c01c60 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:48.325110 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-07e58ef7-ad53-4d52-8a69-68f8585e53a3 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:48.330291 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-07e58ef7-ad53-4d52-8a69-68f8585e53a3 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:48.332220 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-07e58ef7-ad53-4d52-8a69-68f8585e53a3 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:48.332880 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-07e58ef7-ad53-4d52-8a69-68f8585e53a3 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:48.628405 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-5666f1e9-bb26-40c4-8417-d4b217c01c60 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:48.638138 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-5666f1e9-bb26-40c4-8417-d4b217c01c60 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/65b7a5ff-be03-4f45-941c-26a50cdabf02" status: 200 len: 1369 microversion: 2.1 time: 0.334371 Jul 30 05:00:48.640285 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 182/392] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:48 2022] GET /compute/v2.1/servers/65b7a5ff-be03-4f45-941c-26a50cdabf02 => generated 1369 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 05:00:48.646347 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-54112e8c-7ccc-40c8-abbe-4a4b8c71ca39 req-e69e1798-9861-4eaf-a92a-44a7d1372d64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8df9803f-05b0-4d65-aada-31539d50706f", "name": "network-vif-plugged", "status": "completed", "tag": "c9566a0a-7940-4373-8c65-d96596348430"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:00:48.656069 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-54112e8c-7ccc-40c8-abbe-4a4b8c71ca39 req-e69e1798-9861-4eaf-a92a-44a7d1372d64 service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:48.656723 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-54112e8c-7ccc-40c8-abbe-4a4b8c71ca39 req-e69e1798-9861-4eaf-a92a-44a7d1372d64 service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:48.678111 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-54112e8c-7ccc-40c8-abbe-4a4b8c71ca39 req-e69e1798-9861-4eaf-a92a-44a7d1372d64 service nova] Creating event network-vif-plugged:c9566a0a-7940-4373-8c65-d96596348430 for instance 8df9803f-05b0-4d65-aada-31539d50706f on hv-cinder-85127 Jul 30 05:00:48.696448 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-54112e8c-7ccc-40c8-abbe-4a4b8c71ca39 req-e69e1798-9861-4eaf-a92a-44a7d1372d64 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054703 Jul 30 05:00:48.697866 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 183/393] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Jul 30 05:00:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 05:00:48.714958 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-07e58ef7-ad53-4d52-8a69-68f8585e53a3 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8abb58f9c274e568d2d0fe3d4df11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01500cb03c74d1082090cd1c1836169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:48.731415 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-07e58ef7-ad53-4d52-8a69-68f8585e53a3 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/22fe5ad8-01f8-4d0a-bb24-7c23a427d328" status: 200 len: 1367 microversion: 2.1 time: 0.438293 Jul 30 05:00:48.732354 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 211/394] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:48 2022] GET /compute/v2.1/servers/22fe5ad8-01f8-4d0a-bb24-7c23a427d328 => generated 1367 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:00:48.762123 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-b33d0215-f9ce-4721-bb96-583a74a0a3e3 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:48.764205 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-b33d0215-f9ce-4721-bb96-583a74a0a3e3 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] [instance: 8df9803f-05b0-4d65-aada-31539d50706f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:48.784953 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b33d0215-f9ce-4721-bb96-583a74a0a3e3 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:48.786262 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b33d0215-f9ce-4721-bb96-583a74a0a3e3 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:48.787432 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b33d0215-f9ce-4721-bb96-583a74a0a3e3 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:48.788117 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b33d0215-f9ce-4721-bb96-583a74a0a3e3 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:48.833934 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-fa8efefa-56c7-4b79-8985-b4aa8c7ff10f req-950142d1-273e-4a60-8c44-722bfa545630 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65b7a5ff-be03-4f45-941c-26a50cdabf02", "tag": "3ee72598-16cb-4e6d-aa46-89dd6f7ad946"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:00:48.855759 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-fa8efefa-56c7-4b79-8985-b4aa8c7ff10f req-950142d1-273e-4a60-8c44-722bfa545630 service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:48.856251 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-fa8efefa-56c7-4b79-8985-b4aa8c7ff10f req-950142d1-273e-4a60-8c44-722bfa545630 service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:48.883266 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-fa8efefa-56c7-4b79-8985-b4aa8c7ff10f req-950142d1-273e-4a60-8c44-722bfa545630 service nova] Creating event network-changed:3ee72598-16cb-4e6d-aa46-89dd6f7ad946 for instance 65b7a5ff-be03-4f45-941c-26a50cdabf02 on hv-cinder-85127 Jul 30 05:00:48.902253 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-fa8efefa-56c7-4b79-8985-b4aa8c7ff10f req-950142d1-273e-4a60-8c44-722bfa545630 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072748 Jul 30 05:00:48.903374 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 212/395] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Jul 30 05:00:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 05:00:49.131358 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-b33d0215-f9ce-4721-bb96-583a74a0a3e3 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98e41589d15488380a43000a82c2b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f102af4a74e946caa9fefc7ad0ae148c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:49.144692 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-b33d0215-f9ce-4721-bb96-583a74a0a3e3 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] 10.222.0.20 "GET /compute/v2.1/servers/8df9803f-05b0-4d65-aada-31539d50706f" status: 200 len: 1313 microversion: 2.1 time: 0.386574 Jul 30 05:00:49.151818 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 184/396] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:48 2022] GET /compute/v2.1/servers/8df9803f-05b0-4d65-aada-31539d50706f => generated 1313 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:00:49.277237 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-640a0637-8a24-4dc7-8fd8-e8b1a3547e4f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:49.277849 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-640a0637-8a24-4dc7-8fd8-e8b1a3547e4f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:49.301035 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-640a0637-8a24-4dc7-8fd8-e8b1a3547e4f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:49.301601 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-640a0637-8a24-4dc7-8fd8-e8b1a3547e4f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:49.302400 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-640a0637-8a24-4dc7-8fd8-e8b1a3547e4f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:49.302931 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-640a0637-8a24-4dc7-8fd8-e8b1a3547e4f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:49.484642 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-640a0637-8a24-4dc7-8fd8-e8b1a3547e4f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:49.498061 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-640a0637-8a24-4dc7-8fd8-e8b1a3547e4f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:49.499933 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-640a0637-8a24-4dc7-8fd8-e8b1a3547e4f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:49.501121 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-640a0637-8a24-4dc7-8fd8-e8b1a3547e4f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1739 microversion: 2.20 time: 0.228166 Jul 30 05:00:49.501679 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 213/397] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:00:49 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1739 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 05:00:49.662137 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-97653715-c046-4a9f-b860-0c01df366443 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:49.662905 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-97653715-c046-4a9f-b860-0c01df366443 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 65b7a5ff-be03-4f45-941c-26a50cdabf02] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:49.669512 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-97653715-c046-4a9f-b860-0c01df366443 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:49.669947 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-97653715-c046-4a9f-b860-0c01df366443 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:49.671040 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-97653715-c046-4a9f-b860-0c01df366443 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:49.671638 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-97653715-c046-4a9f-b860-0c01df366443 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:49.754065 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-2bdeff71-82e6-456b-a006-19d4fb067664 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:49.755014 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-2bdeff71-82e6-456b-a006-19d4fb067664 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: 22fe5ad8-01f8-4d0a-bb24-7c23a427d328] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:49.761643 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2bdeff71-82e6-456b-a006-19d4fb067664 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:49.762334 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2bdeff71-82e6-456b-a006-19d4fb067664 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:49.763413 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2bdeff71-82e6-456b-a006-19d4fb067664 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:49.764014 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2bdeff71-82e6-456b-a006-19d4fb067664 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:50.030422 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-2bdeff71-82e6-456b-a006-19d4fb067664 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8abb58f9c274e568d2d0fe3d4df11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01500cb03c74d1082090cd1c1836169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:50.041507 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-2bdeff71-82e6-456b-a006-19d4fb067664 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/22fe5ad8-01f8-4d0a-bb24-7c23a427d328" status: 200 len: 1367 microversion: 2.1 time: 0.291742 Jul 30 05:00:50.042136 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 214/398] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:49 2022] GET /compute/v2.1/servers/22fe5ad8-01f8-4d0a-bb24-7c23a427d328 => generated 1367 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 05:00:50.177893 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-94c78952-bd4d-489a-afc5-9daa9b1bb498 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:50.179240 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-94c78952-bd4d-489a-afc5-9daa9b1bb498 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] [instance: 8df9803f-05b0-4d65-aada-31539d50706f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:50.188450 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-94c78952-bd4d-489a-afc5-9daa9b1bb498 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:50.188914 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-94c78952-bd4d-489a-afc5-9daa9b1bb498 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:50.189733 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-94c78952-bd4d-489a-afc5-9daa9b1bb498 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:50.196574 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-94c78952-bd4d-489a-afc5-9daa9b1bb498 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:50.239057 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-97653715-c046-4a9f-b860-0c01df366443 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:50.246672 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-97653715-c046-4a9f-b860-0c01df366443 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/65b7a5ff-be03-4f45-941c-26a50cdabf02" status: 200 len: 1369 microversion: 2.1 time: 0.589476 Jul 30 05:00:50.251844 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 185/399] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:49 2022] GET /compute/v2.1/servers/65b7a5ff-be03-4f45-941c-26a50cdabf02 => generated 1369 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:00:50.525430 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-8ffc7f05-2f83-4291-a413-e7ba917495d9 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:50.526557 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-8ffc7f05-2f83-4291-a413-e7ba917495d9 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:50.534370 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8ffc7f05-2f83-4291-a413-e7ba917495d9 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:50.536494 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-94c78952-bd4d-489a-afc5-9daa9b1bb498 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98e41589d15488380a43000a82c2b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f102af4a74e946caa9fefc7ad0ae148c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:50.544263 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8ffc7f05-2f83-4291-a413-e7ba917495d9 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:50.545884 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8ffc7f05-2f83-4291-a413-e7ba917495d9 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:50.549953 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8ffc7f05-2f83-4291-a413-e7ba917495d9 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:50.552924 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-94c78952-bd4d-489a-afc5-9daa9b1bb498 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] 10.222.0.20 "GET /compute/v2.1/servers/8df9803f-05b0-4d65-aada-31539d50706f" status: 200 len: 1313 microversion: 2.1 time: 0.383981 Jul 30 05:00:50.554304 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 215/400] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:50 2022] GET /compute/v2.1/servers/8df9803f-05b0-4d65-aada-31539d50706f => generated 1313 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:00:50.568368 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell1:SELECT=100 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:00:50.806048 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-8ffc7f05-2f83-4291-a413-e7ba917495d9 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:50.816735 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-8ffc7f05-2f83-4291-a413-e7ba917495d9 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:50.818653 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-8ffc7f05-2f83-4291-a413-e7ba917495d9 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:50.820055 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-8ffc7f05-2f83-4291-a413-e7ba917495d9 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1739 microversion: 2.20 time: 0.298552 Jul 30 05:00:50.821166 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 186/401] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:00:50 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1739 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 05:00:51.067896 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-02f64c40-1d2b-4987-9f33-477983cefefc tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:51.068696 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-02f64c40-1d2b-4987-9f33-477983cefefc tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: 22fe5ad8-01f8-4d0a-bb24-7c23a427d328] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:51.083831 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-02f64c40-1d2b-4987-9f33-477983cefefc tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:51.084399 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-02f64c40-1d2b-4987-9f33-477983cefefc tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:51.085445 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-02f64c40-1d2b-4987-9f33-477983cefefc tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:51.092127 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-02f64c40-1d2b-4987-9f33-477983cefefc tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:51.286382 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-d667b4e6-c420-4861-b9e7-73a8ca2ce598 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:51.317863 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-d667b4e6-c420-4861-b9e7-73a8ca2ce598 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 65b7a5ff-be03-4f45-941c-26a50cdabf02] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:51.327191 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d667b4e6-c420-4861-b9e7-73a8ca2ce598 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:51.327940 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d667b4e6-c420-4861-b9e7-73a8ca2ce598 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:51.328898 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d667b4e6-c420-4861-b9e7-73a8ca2ce598 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:51.329472 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d667b4e6-c420-4861-b9e7-73a8ca2ce598 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:51.407865 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-02f64c40-1d2b-4987-9f33-477983cefefc tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8abb58f9c274e568d2d0fe3d4df11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01500cb03c74d1082090cd1c1836169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:51.418102 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-02f64c40-1d2b-4987-9f33-477983cefefc tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/22fe5ad8-01f8-4d0a-bb24-7c23a427d328" status: 200 len: 1367 microversion: 2.1 time: 0.356291 Jul 30 05:00:51.430469 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 216/402] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:51 2022] GET /compute/v2.1/servers/22fe5ad8-01f8-4d0a-bb24-7c23a427d328 => generated 1367 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:00:51.575114 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-b4da00e9-fb0a-4fe1-b07e-fc8d867c42ed tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:51.575726 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-b4da00e9-fb0a-4fe1-b07e-fc8d867c42ed tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] [instance: 8df9803f-05b0-4d65-aada-31539d50706f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:51.586035 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b4da00e9-fb0a-4fe1-b07e-fc8d867c42ed tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:51.586517 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b4da00e9-fb0a-4fe1-b07e-fc8d867c42ed tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:51.587306 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b4da00e9-fb0a-4fe1-b07e-fc8d867c42ed tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:51.587745 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b4da00e9-fb0a-4fe1-b07e-fc8d867c42ed tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:51.695570 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-d667b4e6-c420-4861-b9e7-73a8ca2ce598 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:51.706375 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-d667b4e6-c420-4861-b9e7-73a8ca2ce598 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/65b7a5ff-be03-4f45-941c-26a50cdabf02" status: 200 len: 1369 microversion: 2.1 time: 0.430423 Jul 30 05:00:51.709665 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 187/403] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:51 2022] GET /compute/v2.1/servers/65b7a5ff-be03-4f45-941c-26a50cdabf02 => generated 1369 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:00:51.838008 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-b4da00e9-fb0a-4fe1-b07e-fc8d867c42ed tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98e41589d15488380a43000a82c2b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f102af4a74e946caa9fefc7ad0ae148c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:51.845017 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-72a3f8eb-6ea2-4ef7-aed8-66431dee91b6 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:51.845789 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-72a3f8eb-6ea2-4ef7-aed8-66431dee91b6 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:51.847369 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-b4da00e9-fb0a-4fe1-b07e-fc8d867c42ed tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] 10.222.0.20 "GET /compute/v2.1/servers/8df9803f-05b0-4d65-aada-31539d50706f" status: 200 len: 1313 microversion: 2.1 time: 0.276079 Jul 30 05:00:51.855606 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-72a3f8eb-6ea2-4ef7-aed8-66431dee91b6 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:51.856720 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-72a3f8eb-6ea2-4ef7-aed8-66431dee91b6 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:51.858506 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-72a3f8eb-6ea2-4ef7-aed8-66431dee91b6 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:51.859454 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-72a3f8eb-6ea2-4ef7-aed8-66431dee91b6 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:51.866256 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 217/404] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:51 2022] GET /compute/v2.1/servers/8df9803f-05b0-4d65-aada-31539d50706f => generated 1313 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:00:52.333128 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-72a3f8eb-6ea2-4ef7-aed8-66431dee91b6 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:52.345294 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-72a3f8eb-6ea2-4ef7-aed8-66431dee91b6 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:52.351642 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-72a3f8eb-6ea2-4ef7-aed8-66431dee91b6 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:52.352828 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-72a3f8eb-6ea2-4ef7-aed8-66431dee91b6 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1739 microversion: 2.20 time: 0.512785 Jul 30 05:00:52.353408 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 188/405] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:00:51 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1739 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 05:00:52.420274 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-0088cdb2-da3b-4c7d-b1b6-ff51b9bc06c2 req-f464babd-a08a-43d0-9529-0c4fd02497c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22fe5ad8-01f8-4d0a-bb24-7c23a427d328", "name": "network-vif-plugged", "status": "completed", "tag": "067511f8-7ca6-4d74-8168-37c6673684c1"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:00:52.432084 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:00:52.443815 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-758191f5-92b9-4865-83dc-4407a8cab1eb tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:52.444598 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-758191f5-92b9-4865-83dc-4407a8cab1eb tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: 22fe5ad8-01f8-4d0a-bb24-7c23a427d328] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:52.453593 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-758191f5-92b9-4865-83dc-4407a8cab1eb tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:52.456823 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-758191f5-92b9-4865-83dc-4407a8cab1eb tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:52.460253 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-758191f5-92b9-4865-83dc-4407a8cab1eb tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:52.462594 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-758191f5-92b9-4865-83dc-4407a8cab1eb tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:52.463461 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-0088cdb2-da3b-4c7d-b1b6-ff51b9bc06c2 req-f464babd-a08a-43d0-9529-0c4fd02497c0 service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:52.463916 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-0088cdb2-da3b-4c7d-b1b6-ff51b9bc06c2 req-f464babd-a08a-43d0-9529-0c4fd02497c0 service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:52.493619 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-0088cdb2-da3b-4c7d-b1b6-ff51b9bc06c2 req-f464babd-a08a-43d0-9529-0c4fd02497c0 service nova] Creating event network-vif-plugged:067511f8-7ca6-4d74-8168-37c6673684c1 for instance 22fe5ad8-01f8-4d0a-bb24-7c23a427d328 on hv-cinder-85127 Jul 30 05:00:52.499075 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-0088cdb2-da3b-4c7d-b1b6-ff51b9bc06c2 req-f464babd-a08a-43d0-9529-0c4fd02497c0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089735 Jul 30 05:00:52.510796 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 218/406] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Jul 30 05:00:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 05:00:52.730397 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-73290471-f9c1-45b9-b686-85f220e9de9d tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:52.731667 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-73290471-f9c1-45b9-b686-85f220e9de9d tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 65b7a5ff-be03-4f45-941c-26a50cdabf02] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:52.741688 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-73290471-f9c1-45b9-b686-85f220e9de9d tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:52.750286 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-73290471-f9c1-45b9-b686-85f220e9de9d tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:52.754282 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-73290471-f9c1-45b9-b686-85f220e9de9d tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:52.757147 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-73290471-f9c1-45b9-b686-85f220e9de9d tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:53.061470 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-758191f5-92b9-4865-83dc-4407a8cab1eb tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8abb58f9c274e568d2d0fe3d4df11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01500cb03c74d1082090cd1c1836169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:53.069784 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-758191f5-92b9-4865-83dc-4407a8cab1eb tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/22fe5ad8-01f8-4d0a-bb24-7c23a427d328" status: 200 len: 1367 microversion: 2.1 time: 0.632391 Jul 30 05:00:53.075325 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 189/407] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:52 2022] GET /compute/v2.1/servers/22fe5ad8-01f8-4d0a-bb24-7c23a427d328 => generated 1367 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:00:53.090831 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-1e9bc4a1-e36e-4639-8003-a22a30f62a05 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:53.091740 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-1e9bc4a1-e36e-4639-8003-a22a30f62a05 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] [instance: 8df9803f-05b0-4d65-aada-31539d50706f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:53.122561 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1e9bc4a1-e36e-4639-8003-a22a30f62a05 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:53.122957 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1e9bc4a1-e36e-4639-8003-a22a30f62a05 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:53.123825 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1e9bc4a1-e36e-4639-8003-a22a30f62a05 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:53.124342 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1e9bc4a1-e36e-4639-8003-a22a30f62a05 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:53.194764 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-73290471-f9c1-45b9-b686-85f220e9de9d tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:53.207719 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-73290471-f9c1-45b9-b686-85f220e9de9d tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/65b7a5ff-be03-4f45-941c-26a50cdabf02" status: 200 len: 1369 microversion: 2.1 time: 0.478776 Jul 30 05:00:53.208802 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 219/408] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:52 2022] GET /compute/v2.1/servers/65b7a5ff-be03-4f45-941c-26a50cdabf02 => generated 1369 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:00:53.386087 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-fc3d7d4e-c957-43d1-bde9-aad4249d2493 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:53.392389 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-fc3d7d4e-c957-43d1-bde9-aad4249d2493 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:53.400915 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fc3d7d4e-c957-43d1-bde9-aad4249d2493 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:53.401983 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fc3d7d4e-c957-43d1-bde9-aad4249d2493 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:53.403222 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fc3d7d4e-c957-43d1-bde9-aad4249d2493 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:53.403958 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fc3d7d4e-c957-43d1-bde9-aad4249d2493 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:53.427564 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-1e9bc4a1-e36e-4639-8003-a22a30f62a05 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98e41589d15488380a43000a82c2b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f102af4a74e946caa9fefc7ad0ae148c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:53.442030 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-1e9bc4a1-e36e-4639-8003-a22a30f62a05 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] 10.222.0.20 "GET /compute/v2.1/servers/8df9803f-05b0-4d65-aada-31539d50706f" status: 200 len: 1497 microversion: 2.1 time: 0.365529 Jul 30 05:00:53.448665 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 190/409] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:53 2022] GET /compute/v2.1/servers/8df9803f-05b0-4d65-aada-31539d50706f => generated 1497 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:00:53.673965 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-fc3d7d4e-c957-43d1-bde9-aad4249d2493 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:53.694800 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-fc3d7d4e-c957-43d1-bde9-aad4249d2493 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:53.697170 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-fc3d7d4e-c957-43d1-bde9-aad4249d2493 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:53.698576 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-fc3d7d4e-c957-43d1-bde9-aad4249d2493 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1739 microversion: 2.20 time: 0.324490 Jul 30 05:00:53.701325 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 220/410] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:00:53 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1739 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 05:00:54.099938 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-9e3c2385-fecb-4221-8814-eb83fe410aa3 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:54.101341 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-9e3c2385-fecb-4221-8814-eb83fe410aa3 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: 22fe5ad8-01f8-4d0a-bb24-7c23a427d328] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:54.125167 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9e3c2385-fecb-4221-8814-eb83fe410aa3 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:54.130864 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9e3c2385-fecb-4221-8814-eb83fe410aa3 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:54.136003 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9e3c2385-fecb-4221-8814-eb83fe410aa3 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:54.139040 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9e3c2385-fecb-4221-8814-eb83fe410aa3 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:54.229102 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-dce1acf8-7ced-4a41-8cef-fd9f0f218366 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:54.229747 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-dce1acf8-7ced-4a41-8cef-fd9f0f218366 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 65b7a5ff-be03-4f45-941c-26a50cdabf02] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:54.240394 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-dce1acf8-7ced-4a41-8cef-fd9f0f218366 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:54.241152 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-dce1acf8-7ced-4a41-8cef-fd9f0f218366 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:54.243177 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-dce1acf8-7ced-4a41-8cef-fd9f0f218366 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:54.244380 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-dce1acf8-7ced-4a41-8cef-fd9f0f218366 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:54.437252 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-dce1acf8-7ced-4a41-8cef-fd9f0f218366 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:54.446594 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-dce1acf8-7ced-4a41-8cef-fd9f0f218366 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/65b7a5ff-be03-4f45-941c-26a50cdabf02" status: 200 len: 1369 microversion: 2.1 time: 0.221569 Jul 30 05:00:54.447906 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 221/411] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:54 2022] GET /compute/v2.1/servers/65b7a5ff-be03-4f45-941c-26a50cdabf02 => generated 1369 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:00:54.453118 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-8fe3db84-89b3-4bda-9bec-f1059a8b6a78 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:54.453615 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-8fe3db84-89b3-4bda-9bec-f1059a8b6a78 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] [instance: 8df9803f-05b0-4d65-aada-31539d50706f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:54.465956 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8fe3db84-89b3-4bda-9bec-f1059a8b6a78 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:54.466507 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8fe3db84-89b3-4bda-9bec-f1059a8b6a78 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:54.467508 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8fe3db84-89b3-4bda-9bec-f1059a8b6a78 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:54.467966 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8fe3db84-89b3-4bda-9bec-f1059a8b6a78 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:54.505583 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-8fe3db84-89b3-4bda-9bec-f1059a8b6a78 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] [instance: 8df9803f-05b0-4d65-aada-31539d50706f] Going to try to terminate instance {{(pid=117886) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 05:00:54.649679 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-9e3c2385-fecb-4221-8814-eb83fe410aa3 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8abb58f9c274e568d2d0fe3d4df11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01500cb03c74d1082090cd1c1836169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:54.664343 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-9e3c2385-fecb-4221-8814-eb83fe410aa3 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/22fe5ad8-01f8-4d0a-bb24-7c23a427d328" status: 200 len: 1367 microversion: 2.1 time: 0.567842 Jul 30 05:00:54.667651 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 191/412] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:54 2022] GET /compute/v2.1/servers/22fe5ad8-01f8-4d0a-bb24-7c23a427d328 => generated 1367 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:00:54.675429 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-45873bd3-d280-4d02-8e04-ed430b6f813b req-128794d0-04a3-4dd2-8873-5f6f4fcf72e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4370e65-bec4-454f-9566-33ff60441229", "name": "network-vif-plugged", "status": "completed", "tag": "77f9d403-dee8-430d-8122-9a468f943da2"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:00:54.681636 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-8fe3db84-89b3-4bda-9bec-f1059a8b6a78 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8df9803f-05b0-4d65-aada-31539d50706f" status: 204 len: 0 microversion: 2.1 time: 0.231624 Jul 30 05:00:54.683159 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 222/413] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Jul 30 05:00:54 2022] DELETE /compute/v2.1/servers/8df9803f-05b0-4d65-aada-31539d50706f => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 05:00:54.699407 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-1945cc6a-5ebf-40f9-8a55-7a30144b00c5 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:54.699954 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-1945cc6a-5ebf-40f9-8a55-7a30144b00c5 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] [instance: 8df9803f-05b0-4d65-aada-31539d50706f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:54.716555 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1945cc6a-5ebf-40f9-8a55-7a30144b00c5 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:54.718906 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-45873bd3-d280-4d02-8e04-ed430b6f813b req-128794d0-04a3-4dd2-8873-5f6f4fcf72e2 service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:54.719670 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1945cc6a-5ebf-40f9-8a55-7a30144b00c5 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:54.725393 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-45873bd3-d280-4d02-8e04-ed430b6f813b req-128794d0-04a3-4dd2-8873-5f6f4fcf72e2 service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:54.728251 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1945cc6a-5ebf-40f9-8a55-7a30144b00c5 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:54.728927 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1945cc6a-5ebf-40f9-8a55-7a30144b00c5 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:54.765470 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-45873bd3-d280-4d02-8e04-ed430b6f813b req-128794d0-04a3-4dd2-8873-5f6f4fcf72e2 service nova] Creating event network-vif-plugged:77f9d403-dee8-430d-8122-9a468f943da2 for instance e4370e65-bec4-454f-9566-33ff60441229 on hv-cinder-85127 Jul 30 05:00:54.805881 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-45873bd3-d280-4d02-8e04-ed430b6f813b req-128794d0-04a3-4dd2-8873-5f6f4fcf72e2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128513 Jul 30 05:00:54.807407 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 192/414] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Jul 30 05:00:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 05:00:54.833437 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell0:SELECT=4 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:00:54.837689 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-ed79adb4-4d2a-47ef-97f9-51181c104c78 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:54.838229 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell0:SELECT=28 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:00:54.840455 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-ed79adb4-4d2a-47ef-97f9-51181c104c78 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:54.862826 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ed79adb4-4d2a-47ef-97f9-51181c104c78 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:54.864579 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ed79adb4-4d2a-47ef-97f9-51181c104c78 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:54.867397 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ed79adb4-4d2a-47ef-97f9-51181c104c78 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:54.867886 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ed79adb4-4d2a-47ef-97f9-51181c104c78 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:54.947166 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell0:SELECT=10 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:00:55.109911 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-ed79adb4-4d2a-47ef-97f9-51181c104c78 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:55.123172 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-1945cc6a-5ebf-40f9-8a55-7a30144b00c5 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98e41589d15488380a43000a82c2b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f102af4a74e946caa9fefc7ad0ae148c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:55.137176 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-ed79adb4-4d2a-47ef-97f9-51181c104c78 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:55.137797 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-1945cc6a-5ebf-40f9-8a55-7a30144b00c5 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] 10.222.0.20 "GET /compute/v2.1/servers/8df9803f-05b0-4d65-aada-31539d50706f" status: 200 len: 1503 microversion: 2.1 time: 0.447818 Jul 30 05:00:55.139165 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-ed79adb4-4d2a-47ef-97f9-51181c104c78 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:55.139864 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 223/415] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:54 2022] GET /compute/v2.1/servers/8df9803f-05b0-4d65-aada-31539d50706f => generated 1503 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:00:55.141246 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-ed79adb4-4d2a-47ef-97f9-51181c104c78 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1739 microversion: 2.20 time: 0.332530 Jul 30 05:00:55.157119 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 193/416] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:00:54 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1739 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 05:00:55.470058 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-d54490d0-33f0-4ff2-820f-51bcd311ae99 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:55.470912 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-d54490d0-33f0-4ff2-820f-51bcd311ae99 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 65b7a5ff-be03-4f45-941c-26a50cdabf02] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:55.480265 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d54490d0-33f0-4ff2-820f-51bcd311ae99 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:55.480720 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d54490d0-33f0-4ff2-820f-51bcd311ae99 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:55.483647 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d54490d0-33f0-4ff2-820f-51bcd311ae99 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:55.484941 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d54490d0-33f0-4ff2-820f-51bcd311ae99 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:55.527745 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:00:55.688991 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-74b53b4a-90d5-47b0-b46e-e73d42eb2928 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:55.694367 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-74b53b4a-90d5-47b0-b46e-e73d42eb2928 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: 22fe5ad8-01f8-4d0a-bb24-7c23a427d328] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:55.722880 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-74b53b4a-90d5-47b0-b46e-e73d42eb2928 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:55.723286 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-74b53b4a-90d5-47b0-b46e-e73d42eb2928 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:55.731868 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-74b53b4a-90d5-47b0-b46e-e73d42eb2928 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:55.732380 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-74b53b4a-90d5-47b0-b46e-e73d42eb2928 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:55.786358 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-d54490d0-33f0-4ff2-820f-51bcd311ae99 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:55.819530 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-d54490d0-33f0-4ff2-820f-51bcd311ae99 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/65b7a5ff-be03-4f45-941c-26a50cdabf02" status: 200 len: 1369 microversion: 2.1 time: 0.350644 Jul 30 05:00:55.820374 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 224/417] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:55 2022] GET /compute/v2.1/servers/65b7a5ff-be03-4f45-941c-26a50cdabf02 => generated 1369 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:00:55.991265 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-74b53b4a-90d5-47b0-b46e-e73d42eb2928 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8abb58f9c274e568d2d0fe3d4df11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01500cb03c74d1082090cd1c1836169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:56.006733 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-74b53b4a-90d5-47b0-b46e-e73d42eb2928 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/22fe5ad8-01f8-4d0a-bb24-7c23a427d328" status: 200 len: 1557 microversion: 2.1 time: 0.319531 Jul 30 05:00:56.008026 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 194/418] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:55 2022] GET /compute/v2.1/servers/22fe5ad8-01f8-4d0a-bb24-7c23a427d328 => generated 1557 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 05:00:56.064774 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-525161c8-f850-4f0f-a08d-955f48153bdd tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:56.065671 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-525161c8-f850-4f0f-a08d-955f48153bdd tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: 22fe5ad8-01f8-4d0a-bb24-7c23a427d328] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:56.080947 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-525161c8-f850-4f0f-a08d-955f48153bdd tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:56.081408 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-525161c8-f850-4f0f-a08d-955f48153bdd tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:56.082215 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-525161c8-f850-4f0f-a08d-955f48153bdd tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:56.082691 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-525161c8-f850-4f0f-a08d-955f48153bdd tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:56.177357 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-490ac94d-0f60-43ec-80ca-9b8a4bfef510 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:56.179979 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-490ac94d-0f60-43ec-80ca-9b8a4bfef510 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] [instance: 8df9803f-05b0-4d65-aada-31539d50706f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:56.191997 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-490ac94d-0f60-43ec-80ca-9b8a4bfef510 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:56.192798 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-490ac94d-0f60-43ec-80ca-9b8a4bfef510 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:56.193877 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-490ac94d-0f60-43ec-80ca-9b8a4bfef510 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:56.194502 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-490ac94d-0f60-43ec-80ca-9b8a4bfef510 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:56.365784 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-490ac94d-0f60-43ec-80ca-9b8a4bfef510 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98e41589d15488380a43000a82c2b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f102af4a74e946caa9fefc7ad0ae148c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:56.374928 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-490ac94d-0f60-43ec-80ca-9b8a4bfef510 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] 10.222.0.20 "GET /compute/v2.1/servers/8df9803f-05b0-4d65-aada-31539d50706f" status: 200 len: 1503 microversion: 2.1 time: 0.206053 Jul 30 05:00:56.390692 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 195/419] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:56 2022] GET /compute/v2.1/servers/8df9803f-05b0-4d65-aada-31539d50706f => generated 1503 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:00:56.397303 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-4e11fd8c-9a9f-45d2-99e8-92999220b468 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:56.398155 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-4e11fd8c-9a9f-45d2-99e8-92999220b468 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:56.404847 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4e11fd8c-9a9f-45d2-99e8-92999220b468 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:56.405544 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4e11fd8c-9a9f-45d2-99e8-92999220b468 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:56.406506 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4e11fd8c-9a9f-45d2-99e8-92999220b468 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:56.407205 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4e11fd8c-9a9f-45d2-99e8-92999220b468 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:56.521079 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-525161c8-f850-4f0f-a08d-955f48153bdd tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/22fe5ad8-01f8-4d0a-bb24-7c23a427d328/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.460346 Jul 30 05:00:56.521661 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 225/420] 10.222.0.20 () {58 vars in 1275 bytes} [Sat Jul 30 05:00:56 2022] GET /compute/v2.1/servers/22fe5ad8-01f8-4d0a-bb24-7c23a427d328/os-interface => generated 285 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 05:00:56.709881 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-4e11fd8c-9a9f-45d2-99e8-92999220b468 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:56.719091 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-4e11fd8c-9a9f-45d2-99e8-92999220b468 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:56.720591 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-4e11fd8c-9a9f-45d2-99e8-92999220b468 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:56.722406 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-4e11fd8c-9a9f-45d2-99e8-92999220b468 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1739 microversion: 2.20 time: 0.330289 Jul 30 05:00:56.730762 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 196/421] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:00:56 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1739 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 05:00:56.847930 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-a9cac8da-42f3-47fa-a2ee-d3e1268ebfdf tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:56.848420 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-a9cac8da-42f3-47fa-a2ee-d3e1268ebfdf tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 65b7a5ff-be03-4f45-941c-26a50cdabf02] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:56.862823 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a9cac8da-42f3-47fa-a2ee-d3e1268ebfdf tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:56.863292 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a9cac8da-42f3-47fa-a2ee-d3e1268ebfdf tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:56.864103 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a9cac8da-42f3-47fa-a2ee-d3e1268ebfdf tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:56.864551 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a9cac8da-42f3-47fa-a2ee-d3e1268ebfdf tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:57.400686 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-159bf141-db24-4cb6-aae7-47abbf29dff0 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:57.402197 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-159bf141-db24-4cb6-aae7-47abbf29dff0 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] [instance: 8df9803f-05b0-4d65-aada-31539d50706f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:57.425798 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-159bf141-db24-4cb6-aae7-47abbf29dff0 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:57.426674 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-159bf141-db24-4cb6-aae7-47abbf29dff0 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:57.430516 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-159bf141-db24-4cb6-aae7-47abbf29dff0 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:57.433479 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-159bf141-db24-4cb6-aae7-47abbf29dff0 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:57.438375 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-a9cac8da-42f3-47fa-a2ee-d3e1268ebfdf tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:57.447765 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-a9cac8da-42f3-47fa-a2ee-d3e1268ebfdf tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/65b7a5ff-be03-4f45-941c-26a50cdabf02" status: 200 len: 1369 microversion: 2.1 time: 0.605903 Jul 30 05:00:57.452838 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 226/422] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:56 2022] GET /compute/v2.1/servers/65b7a5ff-be03-4f45-941c-26a50cdabf02 => generated 1369 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:00:57.465858 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-2824eaa3-ffb0-452d-9581-997e2acf4d4a req-84f64032-1c1b-45e5-8199-c27554a6e5e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65b7a5ff-be03-4f45-941c-26a50cdabf02", "name": "network-vif-plugged", "status": "completed", "tag": "3ee72598-16cb-4e6d-aa46-89dd6f7ad946"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:00:57.503914 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-2824eaa3-ffb0-452d-9581-997e2acf4d4a req-84f64032-1c1b-45e5-8199-c27554a6e5e7 service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:57.504672 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-2824eaa3-ffb0-452d-9581-997e2acf4d4a req-84f64032-1c1b-45e5-8199-c27554a6e5e7 service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:57.521131 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-2824eaa3-ffb0-452d-9581-997e2acf4d4a req-84f64032-1c1b-45e5-8199-c27554a6e5e7 service nova] Creating event network-vif-plugged:3ee72598-16cb-4e6d-aa46-89dd6f7ad946 for instance 65b7a5ff-be03-4f45-941c-26a50cdabf02 on hv-cinder-85127 Jul 30 05:00:57.531177 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-2824eaa3-ffb0-452d-9581-997e2acf4d4a req-84f64032-1c1b-45e5-8199-c27554a6e5e7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074699 Jul 30 05:00:57.532042 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 227/423] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Jul 30 05:00:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 05:00:57.752928 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-6c0c421b-f9fe-44a7-9a32-2f1704baf231 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:57.755281 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-6c0c421b-f9fe-44a7-9a32-2f1704baf231 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:57.770228 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6c0c421b-f9fe-44a7-9a32-2f1704baf231 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:57.772678 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6c0c421b-f9fe-44a7-9a32-2f1704baf231 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:57.776726 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6c0c421b-f9fe-44a7-9a32-2f1704baf231 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:57.778180 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6c0c421b-f9fe-44a7-9a32-2f1704baf231 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:58.101625 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-159bf141-db24-4cb6-aae7-47abbf29dff0 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98e41589d15488380a43000a82c2b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f102af4a74e946caa9fefc7ad0ae148c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:58.117173 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-159bf141-db24-4cb6-aae7-47abbf29dff0 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] 10.222.0.20 "GET /compute/v2.1/servers/8df9803f-05b0-4d65-aada-31539d50706f" status: 200 len: 1503 microversion: 2.1 time: 0.719994 Jul 30 05:00:58.118128 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 197/424] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:57 2022] GET /compute/v2.1/servers/8df9803f-05b0-4d65-aada-31539d50706f => generated 1503 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:00:58.186738 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-6c0c421b-f9fe-44a7-9a32-2f1704baf231 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:58.200252 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-6c0c421b-f9fe-44a7-9a32-2f1704baf231 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:58.206272 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-6c0c421b-f9fe-44a7-9a32-2f1704baf231 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:58.214053 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-6c0c421b-f9fe-44a7-9a32-2f1704baf231 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1739 microversion: 2.20 time: 0.461948 Jul 30 05:00:58.258950 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 228/425] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:00:57 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1739 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 05:00:58.481913 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-2d3d1974-02a0-4560-93e6-93b927846faf tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:58.483767 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-2d3d1974-02a0-4560-93e6-93b927846faf tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 65b7a5ff-be03-4f45-941c-26a50cdabf02] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:58.517448 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2d3d1974-02a0-4560-93e6-93b927846faf tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:58.519174 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2d3d1974-02a0-4560-93e6-93b927846faf tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:58.520395 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2d3d1974-02a0-4560-93e6-93b927846faf tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:58.524012 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2d3d1974-02a0-4560-93e6-93b927846faf tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:59.141984 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-e0a623fd-7f68-4327-ac7f-246188a9ace8 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:59.143886 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-e0a623fd-7f68-4327-ac7f-246188a9ace8 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] [instance: 8df9803f-05b0-4d65-aada-31539d50706f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:59.154292 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e0a623fd-7f68-4327-ac7f-246188a9ace8 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:59.156409 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e0a623fd-7f68-4327-ac7f-246188a9ace8 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:59.157382 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e0a623fd-7f68-4327-ac7f-246188a9ace8 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:59.161833 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e0a623fd-7f68-4327-ac7f-246188a9ace8 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:59.442957 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-2d3d1974-02a0-4560-93e6-93b927846faf tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:59.472380 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-2d3d1974-02a0-4560-93e6-93b927846faf tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/65b7a5ff-be03-4f45-941c-26a50cdabf02" status: 200 len: 1369 microversion: 2.1 time: 0.994337 Jul 30 05:00:59.476683 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 198/426] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:58 2022] GET /compute/v2.1/servers/65b7a5ff-be03-4f45-941c-26a50cdabf02 => generated 1369 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:00:59.496949 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-ff108ada-bb48-43de-9b69-aaabd9bbb631 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:00:59.499303 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-ff108ada-bb48-43de-9b69-aaabd9bbb631 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:00:59.524996 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ff108ada-bb48-43de-9b69-aaabd9bbb631 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:59.526098 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ff108ada-bb48-43de-9b69-aaabd9bbb631 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:59.528134 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ff108ada-bb48-43de-9b69-aaabd9bbb631 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:59.529433 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ff108ada-bb48-43de-9b69-aaabd9bbb631 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:59.591786 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-e0a623fd-7f68-4327-ac7f-246188a9ace8 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98e41589d15488380a43000a82c2b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f102af4a74e946caa9fefc7ad0ae148c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:00:59.600447 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-e0a623fd-7f68-4327-ac7f-246188a9ace8 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] 10.222.0.20 "GET /compute/v2.1/servers/8df9803f-05b0-4d65-aada-31539d50706f" status: 200 len: 1503 microversion: 2.1 time: 0.463920 Jul 30 05:00:59.607956 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 229/427] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:00:59 2022] GET /compute/v2.1/servers/8df9803f-05b0-4d65-aada-31539d50706f => generated 1503 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:00:59.619259 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-f3123d7b-3425-4301-9a4c-6be10678b505 req-009fb007-3673-40dc-ae4d-17296affb6ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22fe5ad8-01f8-4d0a-bb24-7c23a427d328", "tag": "067511f8-7ca6-4d74-8168-37c6673684c1"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:00:59.653145 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-f3123d7b-3425-4301-9a4c-6be10678b505 req-009fb007-3673-40dc-ae4d-17296affb6ad service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:00:59.657490 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-f3123d7b-3425-4301-9a4c-6be10678b505 req-009fb007-3673-40dc-ae4d-17296affb6ad service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:00:59.682342 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-f3123d7b-3425-4301-9a4c-6be10678b505 req-009fb007-3673-40dc-ae4d-17296affb6ad service nova] Creating event network-changed:067511f8-7ca6-4d74-8168-37c6673684c1 for instance 22fe5ad8-01f8-4d0a-bb24-7c23a427d328 on hv-cinder-85127 Jul 30 05:00:59.693039 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-f3123d7b-3425-4301-9a4c-6be10678b505 req-009fb007-3673-40dc-ae4d-17296affb6ad service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077031 Jul 30 05:00:59.695503 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 230/428] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Jul 30 05:00:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 05:01:00.039212 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-c9ff7fdf-406a-4709-a066-17e590884404 req-5db33a01-4b92-41d6-b943-1ccc245800a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8df9803f-05b0-4d65-aada-31539d50706f", "name": "network-vif-deleted", "tag": "c9566a0a-7940-4373-8c65-d96596348430"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:01:00.049817 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-ff108ada-bb48-43de-9b69-aaabd9bbb631 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:00.055263 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-c9ff7fdf-406a-4709-a066-17e590884404 req-5db33a01-4b92-41d6-b943-1ccc245800a5 service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:00.055665 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-c9ff7fdf-406a-4709-a066-17e590884404 req-5db33a01-4b92-41d6-b943-1ccc245800a5 service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:00.062883 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-ff108ada-bb48-43de-9b69-aaabd9bbb631 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:00.066414 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-ff108ada-bb48-43de-9b69-aaabd9bbb631 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:00.071824 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-ff108ada-bb48-43de-9b69-aaabd9bbb631 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1739 microversion: 2.20 time: 0.593873 Jul 30 05:01:00.072707 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 199/429] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:00:59 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1739 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 05:01:00.100687 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-c9ff7fdf-406a-4709-a066-17e590884404 req-5db33a01-4b92-41d6-b943-1ccc245800a5 service nova] Creating event network-vif-deleted:c9566a0a-7940-4373-8c65-d96596348430 for instance 8df9803f-05b0-4d65-aada-31539d50706f on hv-cinder-85127 Jul 30 05:01:00.108137 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-c9ff7fdf-406a-4709-a066-17e590884404 req-5db33a01-4b92-41d6-b943-1ccc245800a5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073706 Jul 30 05:01:00.109328 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 231/430] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Jul 30 05:01:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 05:01:00.499181 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-6e3bca6b-7fb6-4036-a1e7-644f33d2454d tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:00.499970 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-6e3bca6b-7fb6-4036-a1e7-644f33d2454d tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 65b7a5ff-be03-4f45-941c-26a50cdabf02] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:00.516422 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6e3bca6b-7fb6-4036-a1e7-644f33d2454d tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:00.520926 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6e3bca6b-7fb6-4036-a1e7-644f33d2454d tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:00.524528 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6e3bca6b-7fb6-4036-a1e7-644f33d2454d tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:00.524996 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6e3bca6b-7fb6-4036-a1e7-644f33d2454d tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:00.632265 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-7823134c-dcc5-4f14-98d0-be14e42c1a5a tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:00.633756 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-7823134c-dcc5-4f14-98d0-be14e42c1a5a tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] [instance: 8df9803f-05b0-4d65-aada-31539d50706f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:00.654765 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7823134c-dcc5-4f14-98d0-be14e42c1a5a tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:00.655242 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7823134c-dcc5-4f14-98d0-be14e42c1a5a tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:00.668795 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7823134c-dcc5-4f14-98d0-be14e42c1a5a tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:00.670149 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7823134c-dcc5-4f14-98d0-be14e42c1a5a tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:00.798719 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7823134c-dcc5-4f14-98d0-be14e42c1a5a tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:00.800867 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7823134c-dcc5-4f14-98d0-be14e42c1a5a tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:00.803122 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.objects.instance [None req-7823134c-dcc5-4f14-98d0-be14e42c1a5a tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lazy-loading 'fault' on Instance uuid 8df9803f-05b0-4d65-aada-31539d50706f {{(pid=117886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 05:01:00.961809 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-7823134c-dcc5-4f14-98d0-be14e42c1a5a tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98e41589d15488380a43000a82c2b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f102af4a74e946caa9fefc7ad0ae148c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:00.962851 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-6e3bca6b-7fb6-4036-a1e7-644f33d2454d tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:00.974882 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-6e3bca6b-7fb6-4036-a1e7-644f33d2454d tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/65b7a5ff-be03-4f45-941c-26a50cdabf02" status: 200 len: 1563 microversion: 2.1 time: 0.480622 Jul 30 05:01:00.977543 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 200/431] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:01:00 2022] GET /compute/v2.1/servers/65b7a5ff-be03-4f45-941c-26a50cdabf02 => generated 1563 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:01:00.979688 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-7823134c-dcc5-4f14-98d0-be14e42c1a5a tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] 10.222.0.20 "GET /compute/v2.1/servers/8df9803f-05b0-4d65-aada-31539d50706f" status: 200 len: 1303 microversion: 2.1 time: 0.354707 Jul 30 05:01:00.980656 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 232/432] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:01:00 2022] GET /compute/v2.1/servers/8df9803f-05b0-4d65-aada-31539d50706f => generated 1303 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 05:01:00.996671 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-be40f3f9-da5b-445d-9c6b-64ce2ba95aa4 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:00.997232 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-be40f3f9-da5b-445d-9c6b-64ce2ba95aa4 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 65b7a5ff-be03-4f45-941c-26a50cdabf02] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:01.011839 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-be40f3f9-da5b-445d-9c6b-64ce2ba95aa4 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:01.012263 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-be40f3f9-da5b-445d-9c6b-64ce2ba95aa4 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:01.013037 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-be40f3f9-da5b-445d-9c6b-64ce2ba95aa4 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:01.013648 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-be40f3f9-da5b-445d-9c6b-64ce2ba95aa4 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:01.106067 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-eba2adcf-828e-4818-ae5d-e78ddd6c7177 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:01.107433 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-eba2adcf-828e-4818-ae5d-e78ddd6c7177 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:01.120000 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-eba2adcf-828e-4818-ae5d-e78ddd6c7177 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:01.120873 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-eba2adcf-828e-4818-ae5d-e78ddd6c7177 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:01.121889 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-eba2adcf-828e-4818-ae5d-e78ddd6c7177 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:01.123514 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-eba2adcf-828e-4818-ae5d-e78ddd6c7177 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:01.524689 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-eba2adcf-828e-4818-ae5d-e78ddd6c7177 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:01.540046 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-eba2adcf-828e-4818-ae5d-e78ddd6c7177 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:01.541961 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-eba2adcf-828e-4818-ae5d-e78ddd6c7177 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:01.543216 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-eba2adcf-828e-4818-ae5d-e78ddd6c7177 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1739 microversion: 2.20 time: 0.447107 Jul 30 05:01:01.547306 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 233/433] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:01:01 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1739 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 05:01:01.622742 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-be40f3f9-da5b-445d-9c6b-64ce2ba95aa4 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/65b7a5ff-be03-4f45-941c-26a50cdabf02/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.629878 Jul 30 05:01:01.633076 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 201/434] 10.222.0.20 () {58 vars in 1275 bytes} [Sat Jul 30 05:01:00 2022] GET /compute/v2.1/servers/65b7a5ff-be03-4f45-941c-26a50cdabf02/os-interface => generated 284 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 05:01:01.780818 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-3e8decfd-222f-4a72-b362-ac1d0a6f0724 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "32d6af20-5226-430f-add4-ed86c255a0a5", "device": "/dev/sdb"}} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:01:01.785973 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-3e8decfd-222f-4a72-b362-ac1d0a6f0724 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] [instance: fdf672c0-82ac-413b-a8cc-e01a4de45c4e] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:01.819469 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3e8decfd-222f-4a72-b362-ac1d0a6f0724 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:01.823476 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3e8decfd-222f-4a72-b362-ac1d0a6f0724 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:01.824347 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3e8decfd-222f-4a72-b362-ac1d0a6f0724 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:01.824805 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3e8decfd-222f-4a72-b362-ac1d0a6f0724 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:02.011117 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-c2b9ac6e-5d7c-4c39-849a-9e5a04a8b4e3 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:02.011999 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-c2b9ac6e-5d7c-4c39-849a-9e5a04a8b4e3 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] [instance: 8df9803f-05b0-4d65-aada-31539d50706f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:02.033574 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c2b9ac6e-5d7c-4c39-849a-9e5a04a8b4e3 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:02.035291 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c2b9ac6e-5d7c-4c39-849a-9e5a04a8b4e3 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:02.036336 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c2b9ac6e-5d7c-4c39-849a-9e5a04a8b4e3 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:02.036952 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c2b9ac6e-5d7c-4c39-849a-9e5a04a8b4e3 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:02.098299 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.wsgi [None req-c2b9ac6e-5d7c-4c39-849a-9e5a04a8b4e3 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] HTTP exception thrown: Instance 8df9803f-05b0-4d65-aada-31539d50706f could not be found. Jul 30 05:01:02.103807 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-c2b9ac6e-5d7c-4c39-849a-9e5a04a8b4e3 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Request method failure captured: Jul 30 05:01:02.103807 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: request: GET /compute/v2.1/servers/8df9803f-05b0-4d65-aada-31539d50706f HTTP/1.1 Jul 30 05:01:02.103807 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Accept: application/json Jul 30 05:01:02.103807 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Accept-Encoding: identity Jul 30 05:01:02.103807 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Connection: close Jul 30 05:01:02.103807 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Content-Length: 0 Jul 30 05:01:02.103807 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Content-Type: application/json Jul 30 05:01:02.103807 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Host: 10.222.0.20 Jul 30 05:01:02.103807 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Openstack-System-Scope: None Jul 30 05:01:02.103807 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: User-Agent: python-urllib3/1.26.10 Jul 30 05:01:02.103807 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Auth-Token: gAAAAABi5LrxRwAmJ55a8z3q5U635j188V2Cr8mYNRG2XxF-v4rvZne2FAoHdoKdRXioFShbGdL1axBP-3iQBHwNDwEHXmNShh224Z3B-zkkky6S1aG4PZOYn5UT8fkJ09iYZ-7jPLaR3flInr5auV1a-O49hTrSgEuEeMbczpnY7zm1U4ywCv8 Jul 30 05:01:02.103807 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Domain-Id: None Jul 30 05:01:02.103807 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Domain-Name: None Jul 30 05:01:02.103807 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Identity-Status: Confirmed Jul 30 05:01:02.103807 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Is-Admin-Project: True Jul 30 05:01:02.103807 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Domain-Id: default Jul 30 05:01:02.103807 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Domain-Name: Default Jul 30 05:01:02.103807 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Id: f102af4a74e946caa9fefc7ad0ae148c Jul 30 05:01:02.103807 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Name: tempest-VolumesActionsTest-350598693 Jul 30 05:01:02.103807 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Role: member,reader Jul 30 05:01:02.103807 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Roles: member,reader Jul 30 05:01:02.105570 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f102af4a74e946caa9fefc7ad0ae148c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f102af4a74e946caa9fefc7ad0ae148c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f102af4a74e946caa9fefc7ad0ae148c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f102af4a74e946caa9fefc7ad0ae148c"}]}] Jul 30 05:01:02.105570 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Tenant: tempest-VolumesActionsTest-350598693 Jul 30 05:01:02.105570 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Tenant-Id: f102af4a74e946caa9fefc7ad0ae148c Jul 30 05:01:02.105570 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Tenant-Name: tempest-VolumesActionsTest-350598693 Jul 30 05:01:02.105570 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User: tempest-VolumesActionsTest-350598693-project Jul 30 05:01:02.105570 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Domain-Id: default Jul 30 05:01:02.105570 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Domain-Name: Default Jul 30 05:01:02.105570 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Id: b98e41589d15488380a43000a82c2b3c Jul 30 05:01:02.105570 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Name: tempest-VolumesActionsTest-350598693-project Jul 30 05:01:02.105570 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: method: > Jul 30 05:01:02.105570 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: exception: Instance 8df9803f-05b0-4d65-aada-31539d50706f could not be found. Jul 30 05:01:02.105570 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: action_args: {'id': '8df9803f-05b0-4d65-aada-31539d50706f'} Jul 30 05:01:02.106425 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 05:01:02.106425 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:01:02.106425 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 05:01:02.106425 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 05:01:02.106425 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 05:01:02.106425 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 05:01:02.106425 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 05:01:02.106425 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 05:01:02.106425 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 05:01:02.106425 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 05:01:02.106425 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8df9803f-05b0-4d65-aada-31539d50706f could not be found. Jul 30 05:01:02.106425 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:01:02.106425 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 05:01:02.106425 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:01:02.106425 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:01:02.106425 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 05:01:02.106425 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 05:01:02.106425 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 05:01:02.106425 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 05:01:02.106425 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 05:01:02.107905 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 05:01:02.107905 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 05:01:02.107905 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 05:01:02.107905 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 05:01:02.107905 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 05:01:02.107905 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 05:01:02.107905 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 05:01:02.107905 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8df9803f-05b0-4d65-aada-31539d50706f could not be found. Jul 30 05:01:02.107905 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:01:02.107905 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 05:01:02.107905 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:01:02.107905 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:01:02.107905 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 05:01:02.107905 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 05:01:02.107905 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 05:01:02.107905 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 05:01:02.107905 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8df9803f-05b0-4d65-aada-31539d50706f could not be found. Jul 30 05:01:02.107905 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:01:02.112723 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-c2b9ac6e-5d7c-4c39-849a-9e5a04a8b4e3 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Returning 404 to user: Instance 8df9803f-05b0-4d65-aada-31539d50706f could not be found. {{(pid=117885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 05:01:02.114894 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-c2b9ac6e-5d7c-4c39-849a-9e5a04a8b4e3 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] 10.222.0.20 "GET /compute/v2.1/servers/8df9803f-05b0-4d65-aada-31539d50706f" status: 404 len: 111 microversion: 2.1 time: 0.107316 Jul 30 05:01:02.117977 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 202/435] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:01:02 2022] GET /compute/v2.1/servers/8df9803f-05b0-4d65-aada-31539d50706f => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 30 05:01:02.404173 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-78e51c5a-ec01-4dce-a955-8f1173f5db73 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1883327760", "imageRef": "d6a9c8e1-ecb9-4603-bb88-2b0d46ac2387", "flavorRef": "452", "networks": [{"uuid": "67254df2-69cc-4935-a78a-856ecd4c2eaf"}]}} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:01:02.452839 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-3e8decfd-222f-4a72-b362-ac1d0a6f0724 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] 10.222.0.20 "POST /compute/v2.1/servers/fdf672c0-82ac-413b-a8cc-e01a4de45c4e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.676650 Jul 30 05:01:02.454280 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 234/436] 10.222.0.20 () {60 vars in 1323 bytes} [Sat Jul 30 05:01:01 2022] POST /compute/v2.1/servers/fdf672c0-82ac-413b-a8cc-e01a4de45c4e/os-volume_attachments => generated 194 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 05:01:02.571125 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-7e5dfefb-1943-41d6-9e3b-76cd74e151f8 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:02.572120 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-7e5dfefb-1943-41d6-9e3b-76cd74e151f8 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:02.588685 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7e5dfefb-1943-41d6-9e3b-76cd74e151f8 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:02.595363 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7e5dfefb-1943-41d6-9e3b-76cd74e151f8 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:02.596952 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7e5dfefb-1943-41d6-9e3b-76cd74e151f8 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:02.597407 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7e5dfefb-1943-41d6-9e3b-76cd74e151f8 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:02.605000 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.network.neutron [None req-78e51c5a-ec01-4dce-a955-8f1173f5db73 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] validate_networks() for [('67254df2-69cc-4935-a78a-856ecd4c2eaf', None, None, None, None, None)] {{(pid=117885) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 05:01:02.952820 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-7e5dfefb-1943-41d6-9e3b-76cd74e151f8 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:02.965065 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-7e5dfefb-1943-41d6-9e3b-76cd74e151f8 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:02.970921 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-7e5dfefb-1943-41d6-9e3b-76cd74e151f8 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:02.973452 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-7e5dfefb-1943-41d6-9e3b-76cd74e151f8 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1739 microversion: 2.20 time: 0.407731 Jul 30 05:01:02.976511 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 235/437] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:01:02 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1739 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 05:01:03.420738 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-78e51c5a-ec01-4dce-a955-8f1173f5db73 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Flavor limits 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 05:01:03.421299 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-78e51c5a-ec01-4dce-a955-8f1173f5db73 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Image limits 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 05:01:03.421630 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-78e51c5a-ec01-4dce-a955-8f1173f5db73 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Flavor pref 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 05:01:03.422230 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-78e51c5a-ec01-4dce-a955-8f1173f5db73 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Image pref 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 05:01:03.422853 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-78e51c5a-ec01-4dce-a955-8f1173f5db73 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 05:01:03.450253 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-78e51c5a-ec01-4dce-a955-8f1173f5db73 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:03.450982 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-78e51c5a-ec01-4dce-a955-8f1173f5db73 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:03.451944 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-78e51c5a-ec01-4dce-a955-8f1173f5db73 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:03.452556 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-78e51c5a-ec01-4dce-a955-8f1173f5db73 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:03.506520 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.quota [None req-78e51c5a-ec01-4dce-a955-8f1173f5db73 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Getting quotas for project f102af4a74e946caa9fefc7ad0ae148c. Resources: {'ram', 'cores', 'instances'} {{(pid=117885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 05:01:03.511215 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.quota [None req-78e51c5a-ec01-4dce-a955-8f1173f5db73 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Getting quotas for user b98e41589d15488380a43000a82c2b3c and project f102af4a74e946caa9fefc7ad0ae148c. Resources: {'ram', 'cores', 'instances'} {{(pid=117885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 05:01:03.536287 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-78e51c5a-ec01-4dce-a955-8f1173f5db73 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Going to run 1 instances... {{(pid=117885) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 05:01:03.539315 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-78e51c5a-ec01-4dce-a955-8f1173f5db73 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] [instance: a4f0c48f-08ac-4a62-b5f4-7138c10159cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d6a9c8e1-ecb9-4603-bb88-2b0d46ac2387',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 05:01:03.668509 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-78e51c5a-ec01-4dce-a955-8f1173f5db73 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.273215 Jul 30 05:01:03.678160 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 203/438] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Jul 30 05:01:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1284 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 05:01:03.690737 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-3d60e45a-e429-436c-9725-3325520b6c52 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:03.691977 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-3d60e45a-e429-436c-9725-3325520b6c52 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] [instance: a4f0c48f-08ac-4a62-b5f4-7138c10159cb] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:03.983988 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-3d60e45a-e429-436c-9725-3325520b6c52 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98e41589d15488380a43000a82c2b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f102af4a74e946caa9fefc7ad0ae148c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:03.997555 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-3d60e45a-e429-436c-9725-3325520b6c52 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] 10.222.0.20 "GET /compute/v2.1/servers/a4f0c48f-08ac-4a62-b5f4-7138c10159cb" status: 200 len: 1214 microversion: 2.1 time: 0.312115 Jul 30 05:01:04.004736 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-1ee59138-23c9-42e9-99cd-120834b76573 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:04.005448 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-1ee59138-23c9-42e9-99cd-120834b76573 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:04.025729 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1ee59138-23c9-42e9-99cd-120834b76573 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:04.026196 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1ee59138-23c9-42e9-99cd-120834b76573 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:04.032916 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 236/439] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:01:03 2022] GET /compute/v2.1/servers/a4f0c48f-08ac-4a62-b5f4-7138c10159cb => generated 1214 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:01:04.035781 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1ee59138-23c9-42e9-99cd-120834b76573 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:04.047027 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1ee59138-23c9-42e9-99cd-120834b76573 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:04.280122 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-1ee59138-23c9-42e9-99cd-120834b76573 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:04.304236 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-1ee59138-23c9-42e9-99cd-120834b76573 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:04.305772 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-1ee59138-23c9-42e9-99cd-120834b76573 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:04.307076 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-1ee59138-23c9-42e9-99cd-120834b76573 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1739 microversion: 2.20 time: 0.307938 Jul 30 05:01:04.307655 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 204/440] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:01:03 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1739 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 05:01:04.568064 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-d69e82ea-c6e9-4a49-92de-3fd36683817c req-b1e8229e-5421-43ec-b686-04c17dd44407 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65b7a5ff-be03-4f45-941c-26a50cdabf02", "tag": "3ee72598-16cb-4e6d-aa46-89dd6f7ad946"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:01:04.587673 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-d69e82ea-c6e9-4a49-92de-3fd36683817c req-b1e8229e-5421-43ec-b686-04c17dd44407 service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:04.589800 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-d69e82ea-c6e9-4a49-92de-3fd36683817c req-b1e8229e-5421-43ec-b686-04c17dd44407 service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:04.605964 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-d69e82ea-c6e9-4a49-92de-3fd36683817c req-b1e8229e-5421-43ec-b686-04c17dd44407 service nova] Creating event network-changed:3ee72598-16cb-4e6d-aa46-89dd6f7ad946 for instance 65b7a5ff-be03-4f45-941c-26a50cdabf02 on hv-cinder-85127 Jul 30 05:01:04.617403 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-d69e82ea-c6e9-4a49-92de-3fd36683817c req-b1e8229e-5421-43ec-b686-04c17dd44407 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052693 Jul 30 05:01:04.618465 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 237/441] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Jul 30 05:01:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 05:01:05.031906 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-31f5c2e4-a267-4ad9-a915-57cb5ce684e8 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:05.032590 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-31f5c2e4-a267-4ad9-a915-57cb5ce684e8 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] [instance: a4f0c48f-08ac-4a62-b5f4-7138c10159cb] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:05.060650 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-31f5c2e4-a267-4ad9-a915-57cb5ce684e8 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:05.061118 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-31f5c2e4-a267-4ad9-a915-57cb5ce684e8 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:05.066030 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-31f5c2e4-a267-4ad9-a915-57cb5ce684e8 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:05.068923 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-31f5c2e4-a267-4ad9-a915-57cb5ce684e8 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:05.078495 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell1:SELECT=100 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:01:05.277250 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-31f5c2e4-a267-4ad9-a915-57cb5ce684e8 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98e41589d15488380a43000a82c2b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f102af4a74e946caa9fefc7ad0ae148c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:05.290008 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-31f5c2e4-a267-4ad9-a915-57cb5ce684e8 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] 10.222.0.20 "GET /compute/v2.1/servers/a4f0c48f-08ac-4a62-b5f4-7138c10159cb" status: 200 len: 1210 microversion: 2.1 time: 0.261432 Jul 30 05:01:05.293757 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 205/442] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:01:05 2022] GET /compute/v2.1/servers/a4f0c48f-08ac-4a62-b5f4-7138c10159cb => generated 1210 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:01:05.334863 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-12ff9513-54d3-4713-9abd-b34ae4ae573d tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:05.335583 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-12ff9513-54d3-4713-9abd-b34ae4ae573d tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:05.351074 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-12ff9513-54d3-4713-9abd-b34ae4ae573d tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:05.351556 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-12ff9513-54d3-4713-9abd-b34ae4ae573d tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:05.359860 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-12ff9513-54d3-4713-9abd-b34ae4ae573d tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:05.360339 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-12ff9513-54d3-4713-9abd-b34ae4ae573d tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:05.659423 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-12ff9513-54d3-4713-9abd-b34ae4ae573d tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:05.693948 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-12ff9513-54d3-4713-9abd-b34ae4ae573d tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:05.705437 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-12ff9513-54d3-4713-9abd-b34ae4ae573d tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:05.707269 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-12ff9513-54d3-4713-9abd-b34ae4ae573d tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1739 microversion: 2.20 time: 0.378402 Jul 30 05:01:05.713444 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 238/443] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:01:05 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1739 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 05:01:06.168633 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-5887479a-162e-4bda-97ad-4826b9c6876c tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Action: 'create', calling method: .version_select at 0x7f2db43475e0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-275234029", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCv5M7anMaS7d4rLkaCC5Z44aPby9u/0Y834UcCOJHYZxt097Gw4tOLaCoHQh6nzahWr2j+hdZR5RasLJS8jwO+o0IGLDOAconGQiOmlvA1ZOlBLXlMd0LCrPYKxupZxMg=="}} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:01:06.198184 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.quota [None req-5887479a-162e-4bda-97ad-4826b9c6876c tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Getting quotas for project db365a6a9f6041a7a8749fd1a1e3d488. Resources: {'key_pairs'} {{(pid=117885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 05:01:06.202928 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.quota [None req-5887479a-162e-4bda-97ad-4826b9c6876c tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Getting quotas for user 407ad282edd74fb1adf62fb63306779c and project db365a6a9f6041a7a8749fd1a1e3d488. Resources: {'key_pairs'} {{(pid=117885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 05:01:06.242655 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-5887479a-162e-4bda-97ad-4826b9c6876c tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.563410 Jul 30 05:01:06.243927 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 206/444] 10.222.0.20 () {60 vars in 1159 bytes} [Sat Jul 30 05:01:05 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 05:01:06.319877 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-263bae9f-e3ad-4281-ab97-89fd5217514a tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:06.320683 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-263bae9f-e3ad-4281-ab97-89fd5217514a tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] [instance: a4f0c48f-08ac-4a62-b5f4-7138c10159cb] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:06.332508 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-263bae9f-e3ad-4281-ab97-89fd5217514a tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:06.338259 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-263bae9f-e3ad-4281-ab97-89fd5217514a tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:06.339966 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-263bae9f-e3ad-4281-ab97-89fd5217514a tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:06.340567 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-263bae9f-e3ad-4281-ab97-89fd5217514a tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:06.464793 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-263bae9f-e3ad-4281-ab97-89fd5217514a tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98e41589d15488380a43000a82c2b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f102af4a74e946caa9fefc7ad0ae148c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:06.475940 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-263bae9f-e3ad-4281-ab97-89fd5217514a tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] 10.222.0.20 "GET /compute/v2.1/servers/a4f0c48f-08ac-4a62-b5f4-7138c10159cb" status: 200 len: 1272 microversion: 2.1 time: 0.159912 Jul 30 05:01:06.477114 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 239/445] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:01:06 2022] GET /compute/v2.1/servers/a4f0c48f-08ac-4a62-b5f4-7138c10159cb => generated 1272 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:01:06.739660 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-6f020905-f2ef-4d87-b68a-4a727ecf73da tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:06.740430 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-6f020905-f2ef-4d87-b68a-4a727ecf73da tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:06.757192 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6f020905-f2ef-4d87-b68a-4a727ecf73da tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:06.757676 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6f020905-f2ef-4d87-b68a-4a727ecf73da tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:06.758663 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6f020905-f2ef-4d87-b68a-4a727ecf73da tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:06.759141 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6f020905-f2ef-4d87-b68a-4a727ecf73da tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:07.076367 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-6f020905-f2ef-4d87-b68a-4a727ecf73da tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:07.091820 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-6f020905-f2ef-4d87-b68a-4a727ecf73da tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:07.095046 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-6f020905-f2ef-4d87-b68a-4a727ecf73da tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:07.097773 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-6f020905-f2ef-4d87-b68a-4a727ecf73da tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1739 microversion: 2.20 time: 0.363074 Jul 30 05:01:07.100328 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 207/446] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:01:06 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1739 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 05:01:07.501357 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-b2464d9b-83d6-4be3-ab08-e26285e11d48 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:07.502677 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-b2464d9b-83d6-4be3-ab08-e26285e11d48 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] [instance: a4f0c48f-08ac-4a62-b5f4-7138c10159cb] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:07.515056 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b2464d9b-83d6-4be3-ab08-e26285e11d48 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:07.521903 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b2464d9b-83d6-4be3-ab08-e26285e11d48 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:07.523891 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b2464d9b-83d6-4be3-ab08-e26285e11d48 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:07.526814 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b2464d9b-83d6-4be3-ab08-e26285e11d48 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:07.842830 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-b2464d9b-83d6-4be3-ab08-e26285e11d48 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98e41589d15488380a43000a82c2b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f102af4a74e946caa9fefc7ad0ae148c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:07.854665 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-b2464d9b-83d6-4be3-ab08-e26285e11d48 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] 10.222.0.20 "GET /compute/v2.1/servers/a4f0c48f-08ac-4a62-b5f4-7138c10159cb" status: 200 len: 1314 microversion: 2.1 time: 0.358225 Jul 30 05:01:07.857230 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 240/447] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:01:07 2022] GET /compute/v2.1/servers/a4f0c48f-08ac-4a62-b5f4-7138c10159cb => generated 1314 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:01:08.126783 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-bc25178e-67b4-419d-868c-54c461ed95cc tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:08.128545 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-bc25178e-67b4-419d-868c-54c461ed95cc tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:08.144160 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-bc25178e-67b4-419d-868c-54c461ed95cc tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:08.144804 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-bc25178e-67b4-419d-868c-54c461ed95cc tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:08.145757 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-bc25178e-67b4-419d-868c-54c461ed95cc tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:08.146366 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-bc25178e-67b4-419d-868c-54c461ed95cc tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:08.478864 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-bc25178e-67b4-419d-868c-54c461ed95cc tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:08.487839 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-bc25178e-67b4-419d-868c-54c461ed95cc tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:08.495080 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-bc25178e-67b4-419d-868c-54c461ed95cc tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:08.496600 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-bc25178e-67b4-419d-868c-54c461ed95cc tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1739 microversion: 2.20 time: 0.373661 Jul 30 05:01:08.497174 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 208/448] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:01:08 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1739 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 05:01:08.590046 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-a48fa99e-db3f-4820-9958-9a1f3fab4e5e req-64f3bb43-16f4-46db-8f36-05871430a8a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4f0c48f-08ac-4a62-b5f4-7138c10159cb", "tag": "b6093eab-acff-4f9e-9803-4facdba24732"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:01:08.609964 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-a48fa99e-db3f-4820-9958-9a1f3fab4e5e req-64f3bb43-16f4-46db-8f36-05871430a8a8 service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:08.611084 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-a48fa99e-db3f-4820-9958-9a1f3fab4e5e req-64f3bb43-16f4-46db-8f36-05871430a8a8 service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:08.644059 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-a48fa99e-db3f-4820-9958-9a1f3fab4e5e req-64f3bb43-16f4-46db-8f36-05871430a8a8 service nova] Creating event network-changed:b6093eab-acff-4f9e-9803-4facdba24732 for instance a4f0c48f-08ac-4a62-b5f4-7138c10159cb on hv-cinder-85127 Jul 30 05:01:08.655830 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-a48fa99e-db3f-4820-9958-9a1f3fab4e5e req-64f3bb43-16f4-46db-8f36-05871430a8a8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068855 Jul 30 05:01:08.659789 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 241/449] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Jul 30 05:01:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 05:01:08.878078 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-6d6ec27c-38f7-41ff-a68b-9edab2601a52 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:08.878723 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-6d6ec27c-38f7-41ff-a68b-9edab2601a52 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] [instance: a4f0c48f-08ac-4a62-b5f4-7138c10159cb] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:08.887620 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6d6ec27c-38f7-41ff-a68b-9edab2601a52 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:08.888634 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6d6ec27c-38f7-41ff-a68b-9edab2601a52 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:08.889309 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6d6ec27c-38f7-41ff-a68b-9edab2601a52 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:08.890035 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6d6ec27c-38f7-41ff-a68b-9edab2601a52 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:09.083739 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-6d6ec27c-38f7-41ff-a68b-9edab2601a52 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98e41589d15488380a43000a82c2b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f102af4a74e946caa9fefc7ad0ae148c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:09.091524 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-6d6ec27c-38f7-41ff-a68b-9edab2601a52 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] 10.222.0.20 "GET /compute/v2.1/servers/a4f0c48f-08ac-4a62-b5f4-7138c10159cb" status: 200 len: 1314 microversion: 2.1 time: 0.217849 Jul 30 05:01:09.092101 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 209/450] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:01:08 2022] GET /compute/v2.1/servers/a4f0c48f-08ac-4a62-b5f4-7138c10159cb => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:01:09.521961 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-2c597821-5456-4c49-96a1-8eabb3432c17 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:09.523640 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-2c597821-5456-4c49-96a1-8eabb3432c17 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:09.542021 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2c597821-5456-4c49-96a1-8eabb3432c17 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:09.543465 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2c597821-5456-4c49-96a1-8eabb3432c17 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:09.546099 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2c597821-5456-4c49-96a1-8eabb3432c17 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:09.547604 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2c597821-5456-4c49-96a1-8eabb3432c17 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:09.984053 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-2c597821-5456-4c49-96a1-8eabb3432c17 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:09.994358 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-2c597821-5456-4c49-96a1-8eabb3432c17 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:09.995961 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-2c597821-5456-4c49-96a1-8eabb3432c17 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:09.997346 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-2c597821-5456-4c49-96a1-8eabb3432c17 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1739 microversion: 2.20 time: 0.481029 Jul 30 05:01:09.997905 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 242/451] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:01:09 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1739 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 05:01:10.114662 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-313d36d8-2112-4b97-91f5-baedf1bad8a6 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:10.115219 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-313d36d8-2112-4b97-91f5-baedf1bad8a6 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] [instance: a4f0c48f-08ac-4a62-b5f4-7138c10159cb] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:10.117867 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:01:10.123770 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-313d36d8-2112-4b97-91f5-baedf1bad8a6 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:10.124427 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-313d36d8-2112-4b97-91f5-baedf1bad8a6 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:10.125433 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-313d36d8-2112-4b97-91f5-baedf1bad8a6 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:10.125875 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-313d36d8-2112-4b97-91f5-baedf1bad8a6 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:10.320653 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-313d36d8-2112-4b97-91f5-baedf1bad8a6 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98e41589d15488380a43000a82c2b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f102af4a74e946caa9fefc7ad0ae148c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:10.339338 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-313d36d8-2112-4b97-91f5-baedf1bad8a6 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] 10.222.0.20 "GET /compute/v2.1/servers/a4f0c48f-08ac-4a62-b5f4-7138c10159cb" status: 200 len: 1314 microversion: 2.1 time: 0.230097 Jul 30 05:01:10.355062 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 210/452] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:01:10 2022] GET /compute/v2.1/servers/a4f0c48f-08ac-4a62-b5f4-7138c10159cb => generated 1314 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:01:11.021418 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-d92392ab-31f8-4e9e-baa9-e4ae6a571e86 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:11.022032 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-d92392ab-31f8-4e9e-baa9-e4ae6a571e86 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:11.028616 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d92392ab-31f8-4e9e-baa9-e4ae6a571e86 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:11.029148 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d92392ab-31f8-4e9e-baa9-e4ae6a571e86 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:11.029847 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d92392ab-31f8-4e9e-baa9-e4ae6a571e86 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:11.030295 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d92392ab-31f8-4e9e-baa9-e4ae6a571e86 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:11.173177 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-d92392ab-31f8-4e9e-baa9-e4ae6a571e86 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:11.182204 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-d92392ab-31f8-4e9e-baa9-e4ae6a571e86 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:11.183759 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-d92392ab-31f8-4e9e-baa9-e4ae6a571e86 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:11.184934 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-d92392ab-31f8-4e9e-baa9-e4ae6a571e86 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1739 microversion: 2.20 time: 0.168118 Jul 30 05:01:11.185492 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 243/453] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:01:11 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1739 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 05:01:11.364288 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-21c92e1f-402e-4d43-b743-8fd5941c0bd4 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:11.364895 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-21c92e1f-402e-4d43-b743-8fd5941c0bd4 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] [instance: a4f0c48f-08ac-4a62-b5f4-7138c10159cb] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:11.371420 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-21c92e1f-402e-4d43-b743-8fd5941c0bd4 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:11.371864 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-21c92e1f-402e-4d43-b743-8fd5941c0bd4 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:11.372607 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-21c92e1f-402e-4d43-b743-8fd5941c0bd4 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:11.373036 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-21c92e1f-402e-4d43-b743-8fd5941c0bd4 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:11.512426 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-21c92e1f-402e-4d43-b743-8fd5941c0bd4 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98e41589d15488380a43000a82c2b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f102af4a74e946caa9fefc7ad0ae148c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:11.521283 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-21c92e1f-402e-4d43-b743-8fd5941c0bd4 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] 10.222.0.20 "GET /compute/v2.1/servers/a4f0c48f-08ac-4a62-b5f4-7138c10159cb" status: 200 len: 1314 microversion: 2.1 time: 0.161302 Jul 30 05:01:11.521848 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 211/454] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:01:11 2022] GET /compute/v2.1/servers/a4f0c48f-08ac-4a62-b5f4-7138c10159cb => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:01:12.208427 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-c3b2b83a-0f1f-409e-87be-b55a73bdf533 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:12.209044 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-c3b2b83a-0f1f-409e-87be-b55a73bdf533 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:12.215550 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c3b2b83a-0f1f-409e-87be-b55a73bdf533 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:12.216001 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c3b2b83a-0f1f-409e-87be-b55a73bdf533 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:12.216764 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c3b2b83a-0f1f-409e-87be-b55a73bdf533 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:12.217205 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c3b2b83a-0f1f-409e-87be-b55a73bdf533 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:12.221883 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:01:12.358281 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-c3b2b83a-0f1f-409e-87be-b55a73bdf533 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:12.367431 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-c3b2b83a-0f1f-409e-87be-b55a73bdf533 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:12.368934 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-c3b2b83a-0f1f-409e-87be-b55a73bdf533 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:12.370076 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-c3b2b83a-0f1f-409e-87be-b55a73bdf533 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1739 microversion: 2.20 time: 0.165585 Jul 30 05:01:12.370684 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 244/455] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:01:12 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1739 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 05:01:12.542552 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-24f80b43-004c-48f4-a8f2-f9c2c0203948 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:12.543152 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-24f80b43-004c-48f4-a8f2-f9c2c0203948 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] [instance: a4f0c48f-08ac-4a62-b5f4-7138c10159cb] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:12.550946 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-24f80b43-004c-48f4-a8f2-f9c2c0203948 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:12.551507 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-24f80b43-004c-48f4-a8f2-f9c2c0203948 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:12.552552 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-24f80b43-004c-48f4-a8f2-f9c2c0203948 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:12.552989 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-24f80b43-004c-48f4-a8f2-f9c2c0203948 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:12.696888 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-24f80b43-004c-48f4-a8f2-f9c2c0203948 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98e41589d15488380a43000a82c2b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f102af4a74e946caa9fefc7ad0ae148c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:12.704549 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-24f80b43-004c-48f4-a8f2-f9c2c0203948 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] 10.222.0.20 "GET /compute/v2.1/servers/a4f0c48f-08ac-4a62-b5f4-7138c10159cb" status: 200 len: 1314 microversion: 2.1 time: 0.165979 Jul 30 05:01:12.705695 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 212/456] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:01:12 2022] GET /compute/v2.1/servers/a4f0c48f-08ac-4a62-b5f4-7138c10159cb => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:01:13.394517 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-79ea5f9c-a0f9-4a70-b893-85afa1b0bab8 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:13.395066 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-79ea5f9c-a0f9-4a70-b893-85afa1b0bab8 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:13.401685 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-79ea5f9c-a0f9-4a70-b893-85afa1b0bab8 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:13.402124 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-79ea5f9c-a0f9-4a70-b893-85afa1b0bab8 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:13.402916 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-79ea5f9c-a0f9-4a70-b893-85afa1b0bab8 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:13.403435 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-79ea5f9c-a0f9-4a70-b893-85afa1b0bab8 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:13.544120 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-79ea5f9c-a0f9-4a70-b893-85afa1b0bab8 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:13.553037 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-79ea5f9c-a0f9-4a70-b893-85afa1b0bab8 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:13.554721 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-79ea5f9c-a0f9-4a70-b893-85afa1b0bab8 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:13.556001 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-79ea5f9c-a0f9-4a70-b893-85afa1b0bab8 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1739 microversion: 2.20 time: 0.166147 Jul 30 05:01:13.570321 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 245/457] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:01:13 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1739 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 05:01:13.725582 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-236ab2e9-f871-48c5-8a22-6a5c8dc587cb tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:13.726216 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-236ab2e9-f871-48c5-8a22-6a5c8dc587cb tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] [instance: a4f0c48f-08ac-4a62-b5f4-7138c10159cb] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:13.728196 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell0:SELECT=2 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:01:13.734319 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-236ab2e9-f871-48c5-8a22-6a5c8dc587cb tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:13.734904 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-236ab2e9-f871-48c5-8a22-6a5c8dc587cb tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:13.735677 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-236ab2e9-f871-48c5-8a22-6a5c8dc587cb tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:13.736109 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-236ab2e9-f871-48c5-8a22-6a5c8dc587cb tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:13.872451 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-236ab2e9-f871-48c5-8a22-6a5c8dc587cb tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98e41589d15488380a43000a82c2b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f102af4a74e946caa9fefc7ad0ae148c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:13.880457 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-236ab2e9-f871-48c5-8a22-6a5c8dc587cb tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] 10.222.0.20 "GET /compute/v2.1/servers/a4f0c48f-08ac-4a62-b5f4-7138c10159cb" status: 200 len: 1314 microversion: 2.1 time: 0.158945 Jul 30 05:01:13.881197 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 213/458] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:01:13 2022] GET /compute/v2.1/servers/a4f0c48f-08ac-4a62-b5f4-7138c10159cb => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:01:14.579696 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-8bed2bb5-0a7c-4b71-b919-4ae31e249723 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:14.581068 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-8bed2bb5-0a7c-4b71-b919-4ae31e249723 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:14.582946 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell0:SELECT=2 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:01:14.589129 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8bed2bb5-0a7c-4b71-b919-4ae31e249723 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:14.589584 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8bed2bb5-0a7c-4b71-b919-4ae31e249723 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:14.590357 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8bed2bb5-0a7c-4b71-b919-4ae31e249723 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:14.590830 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8bed2bb5-0a7c-4b71-b919-4ae31e249723 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:14.730046 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-8bed2bb5-0a7c-4b71-b919-4ae31e249723 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:14.739977 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-8bed2bb5-0a7c-4b71-b919-4ae31e249723 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:14.741478 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-8bed2bb5-0a7c-4b71-b919-4ae31e249723 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:14.742689 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-8bed2bb5-0a7c-4b71-b919-4ae31e249723 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1721 microversion: 2.20 time: 0.167035 Jul 30 05:01:14.743245 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 246/459] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:01:14 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 05:01:14.902226 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-6b984cfd-7a78-490e-8af1-699136a51268 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:14.902819 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-6b984cfd-7a78-490e-8af1-699136a51268 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] [instance: a4f0c48f-08ac-4a62-b5f4-7138c10159cb] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:14.909449 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6b984cfd-7a78-490e-8af1-699136a51268 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:14.909896 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6b984cfd-7a78-490e-8af1-699136a51268 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:14.910713 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6b984cfd-7a78-490e-8af1-699136a51268 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:14.911501 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6b984cfd-7a78-490e-8af1-699136a51268 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:15.132318 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-6b984cfd-7a78-490e-8af1-699136a51268 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98e41589d15488380a43000a82c2b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f102af4a74e946caa9fefc7ad0ae148c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:15.143879 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-6b984cfd-7a78-490e-8af1-699136a51268 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] 10.222.0.20 "GET /compute/v2.1/servers/a4f0c48f-08ac-4a62-b5f4-7138c10159cb" status: 200 len: 1314 microversion: 2.1 time: 0.245487 Jul 30 05:01:15.144817 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 214/460] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:01:14 2022] GET /compute/v2.1/servers/a4f0c48f-08ac-4a62-b5f4-7138c10159cb => generated 1314 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:01:15.768114 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-ac5bf371-ebde-4870-9efd-a446b3a03fa2 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:15.769192 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-ac5bf371-ebde-4870-9efd-a446b3a03fa2 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:15.775716 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ac5bf371-ebde-4870-9efd-a446b3a03fa2 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:15.776160 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ac5bf371-ebde-4870-9efd-a446b3a03fa2 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:15.776928 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ac5bf371-ebde-4870-9efd-a446b3a03fa2 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:15.777360 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ac5bf371-ebde-4870-9efd-a446b3a03fa2 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:15.924730 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-ac5bf371-ebde-4870-9efd-a446b3a03fa2 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:15.932602 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-ac5bf371-ebde-4870-9efd-a446b3a03fa2 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:15.934111 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-ac5bf371-ebde-4870-9efd-a446b3a03fa2 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:15.935357 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-ac5bf371-ebde-4870-9efd-a446b3a03fa2 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1721 microversion: 2.20 time: 0.172859 Jul 30 05:01:15.935933 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 247/461] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:01:15 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1721 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 05:01:16.167734 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-024b4679-2e25-4292-84c2-73650e89124f tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:16.168353 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-024b4679-2e25-4292-84c2-73650e89124f tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] [instance: a4f0c48f-08ac-4a62-b5f4-7138c10159cb] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:16.175878 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-024b4679-2e25-4292-84c2-73650e89124f tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:16.176333 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-024b4679-2e25-4292-84c2-73650e89124f tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:16.177096 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-024b4679-2e25-4292-84c2-73650e89124f tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:16.177536 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-024b4679-2e25-4292-84c2-73650e89124f tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:16.214336 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell0:SELECT=10 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:01:16.313118 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-024b4679-2e25-4292-84c2-73650e89124f tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98e41589d15488380a43000a82c2b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f102af4a74e946caa9fefc7ad0ae148c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:16.320570 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-024b4679-2e25-4292-84c2-73650e89124f tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] 10.222.0.20 "GET /compute/v2.1/servers/a4f0c48f-08ac-4a62-b5f4-7138c10159cb" status: 200 len: 1314 microversion: 2.1 time: 0.157125 Jul 30 05:01:16.321127 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 215/462] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:01:16 2022] GET /compute/v2.1/servers/a4f0c48f-08ac-4a62-b5f4-7138c10159cb => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:01:16.959235 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-8c3ddac8-1d12-44bf-8011-1f85707990b5 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:16.959984 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-8c3ddac8-1d12-44bf-8011-1f85707990b5 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:16.965973 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8c3ddac8-1d12-44bf-8011-1f85707990b5 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:16.966419 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8c3ddac8-1d12-44bf-8011-1f85707990b5 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:16.967216 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8c3ddac8-1d12-44bf-8011-1f85707990b5 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:16.967653 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8c3ddac8-1d12-44bf-8011-1f85707990b5 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:17.101118 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-8c3ddac8-1d12-44bf-8011-1f85707990b5 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:17.109301 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-8c3ddac8-1d12-44bf-8011-1f85707990b5 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:17.110832 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-8c3ddac8-1d12-44bf-8011-1f85707990b5 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:17.112735 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-8c3ddac8-1d12-44bf-8011-1f85707990b5 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1721 microversion: 2.20 time: 0.158100 Jul 30 05:01:17.113280 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 248/463] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:01:16 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 05:01:17.341418 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-37211674-d896-4e01-b990-7f46211bbb55 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:17.342031 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-37211674-d896-4e01-b990-7f46211bbb55 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] [instance: a4f0c48f-08ac-4a62-b5f4-7138c10159cb] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:17.349238 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-37211674-d896-4e01-b990-7f46211bbb55 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:17.349696 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-37211674-d896-4e01-b990-7f46211bbb55 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:17.350457 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-37211674-d896-4e01-b990-7f46211bbb55 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:17.350906 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-37211674-d896-4e01-b990-7f46211bbb55 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:17.484659 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-37211674-d896-4e01-b990-7f46211bbb55 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98e41589d15488380a43000a82c2b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f102af4a74e946caa9fefc7ad0ae148c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:17.492198 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-37211674-d896-4e01-b990-7f46211bbb55 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] 10.222.0.20 "GET /compute/v2.1/servers/a4f0c48f-08ac-4a62-b5f4-7138c10159cb" status: 200 len: 1314 microversion: 2.1 time: 0.154628 Jul 30 05:01:17.492771 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 216/464] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:01:17 2022] GET /compute/v2.1/servers/a4f0c48f-08ac-4a62-b5f4-7138c10159cb => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:01:18.135909 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-2e32ba11-76e8-4377-8c92-b868a32cb3bf tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:18.136518 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-2e32ba11-76e8-4377-8c92-b868a32cb3bf tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:18.144025 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2e32ba11-76e8-4377-8c92-b868a32cb3bf tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:18.144495 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2e32ba11-76e8-4377-8c92-b868a32cb3bf tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:18.145321 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2e32ba11-76e8-4377-8c92-b868a32cb3bf tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:18.145836 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2e32ba11-76e8-4377-8c92-b868a32cb3bf tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:18.285261 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-2e32ba11-76e8-4377-8c92-b868a32cb3bf tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:18.293155 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-2e32ba11-76e8-4377-8c92-b868a32cb3bf tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:18.294977 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-2e32ba11-76e8-4377-8c92-b868a32cb3bf tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:18.296123 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-2e32ba11-76e8-4377-8c92-b868a32cb3bf tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1721 microversion: 2.20 time: 0.164073 Jul 30 05:01:18.296771 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 249/465] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:01:18 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 05:01:18.513362 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-6091ccb7-8399-4225-9b45-e5c41b87dc12 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:18.513975 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-6091ccb7-8399-4225-9b45-e5c41b87dc12 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] [instance: a4f0c48f-08ac-4a62-b5f4-7138c10159cb] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:18.521424 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6091ccb7-8399-4225-9b45-e5c41b87dc12 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:18.521949 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6091ccb7-8399-4225-9b45-e5c41b87dc12 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:18.522790 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6091ccb7-8399-4225-9b45-e5c41b87dc12 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:18.523230 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6091ccb7-8399-4225-9b45-e5c41b87dc12 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:18.660536 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-6091ccb7-8399-4225-9b45-e5c41b87dc12 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98e41589d15488380a43000a82c2b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f102af4a74e946caa9fefc7ad0ae148c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:18.667933 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-6091ccb7-8399-4225-9b45-e5c41b87dc12 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] 10.222.0.20 "GET /compute/v2.1/servers/a4f0c48f-08ac-4a62-b5f4-7138c10159cb" status: 200 len: 1314 microversion: 2.1 time: 0.158423 Jul 30 05:01:18.668739 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 217/466] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:01:18 2022] GET /compute/v2.1/servers/a4f0c48f-08ac-4a62-b5f4-7138c10159cb => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:01:19.320220 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-79671416-b5a2-4bc0-9f11-ffeb644a582b tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:19.320834 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-79671416-b5a2-4bc0-9f11-ffeb644a582b tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:19.327384 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-79671416-b5a2-4bc0-9f11-ffeb644a582b tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:19.327830 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-79671416-b5a2-4bc0-9f11-ffeb644a582b tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:19.328594 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-79671416-b5a2-4bc0-9f11-ffeb644a582b tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:19.329030 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-79671416-b5a2-4bc0-9f11-ffeb644a582b tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:19.477279 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-79671416-b5a2-4bc0-9f11-ffeb644a582b tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:19.488960 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-79671416-b5a2-4bc0-9f11-ffeb644a582b tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:19.490912 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-79671416-b5a2-4bc0-9f11-ffeb644a582b tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:19.492127 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-79671416-b5a2-4bc0-9f11-ffeb644a582b tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1721 microversion: 2.20 time: 0.175792 Jul 30 05:01:19.507545 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 250/467] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:01:19 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1721 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 05:01:19.542561 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-9a90312b-faa3-4276-8eb6-b6624be81c7d req-8639e59e-46ca-489b-80ad-fb752c0f26de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4370e65-bec4-454f-9566-33ff60441229", "name": "network-vif-unplugged", "status": "completed", "tag": "77f9d403-dee8-430d-8122-9a468f943da2"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:01:19.552846 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-9a90312b-faa3-4276-8eb6-b6624be81c7d req-8639e59e-46ca-489b-80ad-fb752c0f26de service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:19.553373 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-9a90312b-faa3-4276-8eb6-b6624be81c7d req-8639e59e-46ca-489b-80ad-fb752c0f26de service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:19.565226 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-9a90312b-faa3-4276-8eb6-b6624be81c7d req-8639e59e-46ca-489b-80ad-fb752c0f26de service nova] Creating event network-vif-unplugged:77f9d403-dee8-430d-8122-9a468f943da2 for instance e4370e65-bec4-454f-9566-33ff60441229 on hv-cinder-85127 Jul 30 05:01:19.570182 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-9a90312b-faa3-4276-8eb6-b6624be81c7d req-8639e59e-46ca-489b-80ad-fb752c0f26de service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031833 Jul 30 05:01:19.570817 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 218/468] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Jul 30 05:01:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 05:01:19.689122 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-fb468af3-99c7-440e-a828-d4836340353a tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:19.690252 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-fb468af3-99c7-440e-a828-d4836340353a tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] [instance: a4f0c48f-08ac-4a62-b5f4-7138c10159cb] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:19.696447 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fb468af3-99c7-440e-a828-d4836340353a tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:19.696899 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fb468af3-99c7-440e-a828-d4836340353a tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:19.697679 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fb468af3-99c7-440e-a828-d4836340353a tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:19.698114 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fb468af3-99c7-440e-a828-d4836340353a tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:19.829462 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-fb468af3-99c7-440e-a828-d4836340353a tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98e41589d15488380a43000a82c2b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f102af4a74e946caa9fefc7ad0ae148c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:19.837483 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-fb468af3-99c7-440e-a828-d4836340353a tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] 10.222.0.20 "GET /compute/v2.1/servers/a4f0c48f-08ac-4a62-b5f4-7138c10159cb" status: 200 len: 1314 microversion: 2.1 time: 0.152258 Jul 30 05:01:19.838048 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 251/469] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:01:19 2022] GET /compute/v2.1/servers/a4f0c48f-08ac-4a62-b5f4-7138c10159cb => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:01:20.517605 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-262887f7-f205-49ca-b03a-a65d848dfdc4 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:20.518305 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-262887f7-f205-49ca-b03a-a65d848dfdc4 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:20.524503 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-262887f7-f205-49ca-b03a-a65d848dfdc4 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:20.524960 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-262887f7-f205-49ca-b03a-a65d848dfdc4 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:20.525726 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-262887f7-f205-49ca-b03a-a65d848dfdc4 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:20.526166 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-262887f7-f205-49ca-b03a-a65d848dfdc4 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:20.657670 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-262887f7-f205-49ca-b03a-a65d848dfdc4 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:20.666896 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-262887f7-f205-49ca-b03a-a65d848dfdc4 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:20.668413 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-262887f7-f205-49ca-b03a-a65d848dfdc4 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:20.669849 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-262887f7-f205-49ca-b03a-a65d848dfdc4 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1721 microversion: 2.20 time: 0.156249 Jul 30 05:01:20.670411 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 219/470] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:01:20 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 05:01:20.858070 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-a5080e8b-1613-4dbe-a798-d645dddb2cad tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:20.858724 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-a5080e8b-1613-4dbe-a798-d645dddb2cad tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] [instance: a4f0c48f-08ac-4a62-b5f4-7138c10159cb] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:20.865289 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a5080e8b-1613-4dbe-a798-d645dddb2cad tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:20.865740 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a5080e8b-1613-4dbe-a798-d645dddb2cad tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:20.866536 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a5080e8b-1613-4dbe-a798-d645dddb2cad tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:20.866972 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a5080e8b-1613-4dbe-a798-d645dddb2cad tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:21.000899 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-a5080e8b-1613-4dbe-a798-d645dddb2cad tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98e41589d15488380a43000a82c2b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f102af4a74e946caa9fefc7ad0ae148c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:21.009655 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-a5080e8b-1613-4dbe-a798-d645dddb2cad tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] 10.222.0.20 "GET /compute/v2.1/servers/a4f0c48f-08ac-4a62-b5f4-7138c10159cb" status: 200 len: 1314 microversion: 2.1 time: 0.155335 Jul 30 05:01:21.010250 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 252/471] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:01:20 2022] GET /compute/v2.1/servers/a4f0c48f-08ac-4a62-b5f4-7138c10159cb => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:01:21.693400 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-9fa4b73c-72e4-4021-9be6-5570ddb929e4 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:21.693935 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-9fa4b73c-72e4-4021-9be6-5570ddb929e4 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:21.700620 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9fa4b73c-72e4-4021-9be6-5570ddb929e4 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:21.701075 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9fa4b73c-72e4-4021-9be6-5570ddb929e4 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:21.702102 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9fa4b73c-72e4-4021-9be6-5570ddb929e4 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:21.702588 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9fa4b73c-72e4-4021-9be6-5570ddb929e4 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:21.836306 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-9fa4b73c-72e4-4021-9be6-5570ddb929e4 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:21.844131 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-9fa4b73c-72e4-4021-9be6-5570ddb929e4 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:21.845722 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-9fa4b73c-72e4-4021-9be6-5570ddb929e4 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:21.847520 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-9fa4b73c-72e4-4021-9be6-5570ddb929e4 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1721 microversion: 2.20 time: 0.158252 Jul 30 05:01:21.848076 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 220/472] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:01:21 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 05:01:22.030986 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-4aefa453-eaec-42b1-8fe2-9c888e4b0174 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:22.031602 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-4aefa453-eaec-42b1-8fe2-9c888e4b0174 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] [instance: a4f0c48f-08ac-4a62-b5f4-7138c10159cb] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:22.038562 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4aefa453-eaec-42b1-8fe2-9c888e4b0174 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:22.039012 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4aefa453-eaec-42b1-8fe2-9c888e4b0174 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:22.039766 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4aefa453-eaec-42b1-8fe2-9c888e4b0174 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:22.040199 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4aefa453-eaec-42b1-8fe2-9c888e4b0174 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:22.167095 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-4aefa453-eaec-42b1-8fe2-9c888e4b0174 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98e41589d15488380a43000a82c2b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f102af4a74e946caa9fefc7ad0ae148c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:22.175930 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-4aefa453-eaec-42b1-8fe2-9c888e4b0174 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] 10.222.0.20 "GET /compute/v2.1/servers/a4f0c48f-08ac-4a62-b5f4-7138c10159cb" status: 200 len: 1314 microversion: 2.1 time: 0.147599 Jul 30 05:01:22.176503 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 253/473] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:01:22 2022] GET /compute/v2.1/servers/a4f0c48f-08ac-4a62-b5f4-7138c10159cb => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:01:22.870619 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-435a3869-3dbb-4d70-ab93-a191635a3ad3 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:22.871226 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-435a3869-3dbb-4d70-ab93-a191635a3ad3 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:22.878119 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-435a3869-3dbb-4d70-ab93-a191635a3ad3 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:22.878601 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-435a3869-3dbb-4d70-ab93-a191635a3ad3 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:22.879364 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-435a3869-3dbb-4d70-ab93-a191635a3ad3 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:22.879796 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-435a3869-3dbb-4d70-ab93-a191635a3ad3 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:23.006378 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-435a3869-3dbb-4d70-ab93-a191635a3ad3 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:23.014383 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-435a3869-3dbb-4d70-ab93-a191635a3ad3 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:23.015913 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-435a3869-3dbb-4d70-ab93-a191635a3ad3 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:23.017062 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-435a3869-3dbb-4d70-ab93-a191635a3ad3 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1721 microversion: 2.20 time: 0.150331 Jul 30 05:01:23.017617 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 221/474] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:01:22 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 05:01:23.197018 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-1f327a79-cf02-4873-9278-1dcf25566ab0 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:23.197555 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-1f327a79-cf02-4873-9278-1dcf25566ab0 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] [instance: a4f0c48f-08ac-4a62-b5f4-7138c10159cb] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:23.199853 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:01:23.205184 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1f327a79-cf02-4873-9278-1dcf25566ab0 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:23.205628 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1f327a79-cf02-4873-9278-1dcf25566ab0 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:23.206384 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1f327a79-cf02-4873-9278-1dcf25566ab0 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:23.206844 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1f327a79-cf02-4873-9278-1dcf25566ab0 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:23.339465 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-1f327a79-cf02-4873-9278-1dcf25566ab0 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98e41589d15488380a43000a82c2b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f102af4a74e946caa9fefc7ad0ae148c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:23.347627 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-1f327a79-cf02-4873-9278-1dcf25566ab0 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] 10.222.0.20 "GET /compute/v2.1/servers/a4f0c48f-08ac-4a62-b5f4-7138c10159cb" status: 200 len: 1314 microversion: 2.1 time: 0.154561 Jul 30 05:01:23.348190 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 254/475] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:01:23 2022] GET /compute/v2.1/servers/a4f0c48f-08ac-4a62-b5f4-7138c10159cb => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:01:24.040977 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-a97f7bce-e2d0-486e-9ae2-854d25466519 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:24.041626 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-a97f7bce-e2d0-486e-9ae2-854d25466519 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:24.048845 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a97f7bce-e2d0-486e-9ae2-854d25466519 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:24.049351 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a97f7bce-e2d0-486e-9ae2-854d25466519 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:24.050164 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a97f7bce-e2d0-486e-9ae2-854d25466519 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:24.050641 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a97f7bce-e2d0-486e-9ae2-854d25466519 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:24.216172 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-a97f7bce-e2d0-486e-9ae2-854d25466519 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:24.226358 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-a97f7bce-e2d0-486e-9ae2-854d25466519 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:24.228338 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-a97f7bce-e2d0-486e-9ae2-854d25466519 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:24.229766 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-a97f7bce-e2d0-486e-9ae2-854d25466519 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1724 microversion: 2.20 time: 0.192928 Jul 30 05:01:24.230573 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 222/476] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:01:24 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1724 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 05:01:24.253942 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-c46d5b03-08b2-4ad9-a9f9-6c027d8002c4 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "51865069-d6f2-4955-924b-bf9d31edae15"}} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:01:24.256421 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-c46d5b03-08b2-4ad9-a9f9-6c027d8002c4 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:24.262924 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c46d5b03-08b2-4ad9-a9f9-6c027d8002c4 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:24.263374 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c46d5b03-08b2-4ad9-a9f9-6c027d8002c4 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:24.264144 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c46d5b03-08b2-4ad9-a9f9-6c027d8002c4 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:24.264575 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c46d5b03-08b2-4ad9-a9f9-6c027d8002c4 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:24.368156 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-90540de4-e8b4-4036-9d3f-e7a9c12dfabf tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:24.368773 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-90540de4-e8b4-4036-9d3f-e7a9c12dfabf tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] [instance: a4f0c48f-08ac-4a62-b5f4-7138c10159cb] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:24.374829 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-90540de4-e8b4-4036-9d3f-e7a9c12dfabf tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:24.375283 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-90540de4-e8b4-4036-9d3f-e7a9c12dfabf tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:24.376045 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-90540de4-e8b4-4036-9d3f-e7a9c12dfabf tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:24.376485 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-90540de4-e8b4-4036-9d3f-e7a9c12dfabf tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:24.395873 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell1:SELECT=100 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:01:24.537489 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-90540de4-e8b4-4036-9d3f-e7a9c12dfabf tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98e41589d15488380a43000a82c2b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f102af4a74e946caa9fefc7ad0ae148c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:24.547460 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-90540de4-e8b4-4036-9d3f-e7a9c12dfabf tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] 10.222.0.20 "GET /compute/v2.1/servers/a4f0c48f-08ac-4a62-b5f4-7138c10159cb" status: 200 len: 1314 microversion: 2.1 time: 0.182848 Jul 30 05:01:24.548513 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 223/477] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:01:24 2022] GET /compute/v2.1/servers/a4f0c48f-08ac-4a62-b5f4-7138c10159cb => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 05:01:24.593452 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-c46d5b03-08b2-4ad9-a9f9-6c027d8002c4 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "POST /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.343675 Jul 30 05:01:24.594779 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 255/478] 10.222.0.20 () {62 vars in 1364 bytes} [Sat Jul 30 05:01:24 2022] POST /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229/os-volume_attachments => generated 188 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 05:01:24.731274 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-b5f90302-594f-4b55-b36d-171ad399d5ba tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:01:24.731948 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-b5f90302-594f-4b55-b36d-171ad399d5ba tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:24.738671 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b5f90302-594f-4b55-b36d-171ad399d5ba tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:24.739214 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b5f90302-594f-4b55-b36d-171ad399d5ba tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:24.740210 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b5f90302-594f-4b55-b36d-171ad399d5ba tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:24.740724 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b5f90302-594f-4b55-b36d-171ad399d5ba tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:24.786607 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-b5f90302-594f-4b55-b36d-171ad399d5ba tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=117885) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Jul 30 05:01:24.853362 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-b5f90302-594f-4b55-b36d-171ad399d5ba tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "POST /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229/action" status: 202 len: 0 microversion: 2.20 time: 0.125991 Jul 30 05:01:24.853951 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 224/479] 10.222.0.20 () {62 vars in 1319 bytes} [Sat Jul 30 05:01:24 2022] POST /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 30 05:01:24.862682 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-82512e3b-db51-451c-8a44-d0d754d543de tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:24.863295 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-82512e3b-db51-451c-8a44-d0d754d543de tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:24.870019 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-82512e3b-db51-451c-8a44-d0d754d543de tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:24.870487 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-82512e3b-db51-451c-8a44-d0d754d543de tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:24.871250 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-82512e3b-db51-451c-8a44-d0d754d543de tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:24.871678 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-82512e3b-db51-451c-8a44-d0d754d543de tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:25.029803 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-82512e3b-db51-451c-8a44-d0d754d543de tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:25.039553 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-82512e3b-db51-451c-8a44-d0d754d543de tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:25.041339 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-82512e3b-db51-451c-8a44-d0d754d543de tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:25.042525 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-82512e3b-db51-451c-8a44-d0d754d543de tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1750 microversion: 2.20 time: 0.184236 Jul 30 05:01:25.043093 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 256/480] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:01:24 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1750 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 05:01:25.570250 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-1dfba077-cac7-4926-8e2b-ae089becebb3 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:25.570899 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-1dfba077-cac7-4926-8e2b-ae089becebb3 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] [instance: a4f0c48f-08ac-4a62-b5f4-7138c10159cb] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:25.577006 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1dfba077-cac7-4926-8e2b-ae089becebb3 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:25.577454 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1dfba077-cac7-4926-8e2b-ae089becebb3 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:25.578205 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1dfba077-cac7-4926-8e2b-ae089becebb3 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:25.578759 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1dfba077-cac7-4926-8e2b-ae089becebb3 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:25.717539 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-1dfba077-cac7-4926-8e2b-ae089becebb3 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98e41589d15488380a43000a82c2b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f102af4a74e946caa9fefc7ad0ae148c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:25.727066 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-1dfba077-cac7-4926-8e2b-ae089becebb3 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] 10.222.0.20 "GET /compute/v2.1/servers/a4f0c48f-08ac-4a62-b5f4-7138c10159cb" status: 200 len: 1314 microversion: 2.1 time: 0.161593 Jul 30 05:01:25.727915 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 225/481] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:01:25 2022] GET /compute/v2.1/servers/a4f0c48f-08ac-4a62-b5f4-7138c10159cb => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:01:26.067111 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-cc3121c2-bcac-4357-aa5f-9ecdab16c58e tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:26.067652 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-cc3121c2-bcac-4357-aa5f-9ecdab16c58e tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:26.074108 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cc3121c2-bcac-4357-aa5f-9ecdab16c58e tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:26.074593 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cc3121c2-bcac-4357-aa5f-9ecdab16c58e tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:26.075356 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cc3121c2-bcac-4357-aa5f-9ecdab16c58e tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:26.075820 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cc3121c2-bcac-4357-aa5f-9ecdab16c58e tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:26.202259 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-cc3121c2-bcac-4357-aa5f-9ecdab16c58e tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:26.210567 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-cc3121c2-bcac-4357-aa5f-9ecdab16c58e tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:26.212069 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-cc3121c2-bcac-4357-aa5f-9ecdab16c58e tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:26.213215 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-cc3121c2-bcac-4357-aa5f-9ecdab16c58e tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1750 microversion: 2.20 time: 0.150699 Jul 30 05:01:26.213775 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 257/482] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:01:26 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1750 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 05:01:26.748267 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-e2a5a0b4-13e1-4b7f-85d0-72b8bd1d80b9 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:26.748881 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-e2a5a0b4-13e1-4b7f-85d0-72b8bd1d80b9 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] [instance: a4f0c48f-08ac-4a62-b5f4-7138c10159cb] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:26.755757 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e2a5a0b4-13e1-4b7f-85d0-72b8bd1d80b9 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:26.756202 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e2a5a0b4-13e1-4b7f-85d0-72b8bd1d80b9 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:26.756958 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e2a5a0b4-13e1-4b7f-85d0-72b8bd1d80b9 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:26.757388 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e2a5a0b4-13e1-4b7f-85d0-72b8bd1d80b9 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:26.891608 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-e2a5a0b4-13e1-4b7f-85d0-72b8bd1d80b9 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98e41589d15488380a43000a82c2b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f102af4a74e946caa9fefc7ad0ae148c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:26.899573 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-e2a5a0b4-13e1-4b7f-85d0-72b8bd1d80b9 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] 10.222.0.20 "GET /compute/v2.1/servers/a4f0c48f-08ac-4a62-b5f4-7138c10159cb" status: 200 len: 1314 microversion: 2.1 time: 0.155093 Jul 30 05:01:26.900152 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 226/483] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:01:26 2022] GET /compute/v2.1/servers/a4f0c48f-08ac-4a62-b5f4-7138c10159cb => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:01:27.236149 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-af5bbdc0-ca42-4111-8cab-6bfa0c5d0058 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:27.236838 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-af5bbdc0-ca42-4111-8cab-6bfa0c5d0058 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:27.244530 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-af5bbdc0-ca42-4111-8cab-6bfa0c5d0058 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:27.244981 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-af5bbdc0-ca42-4111-8cab-6bfa0c5d0058 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:27.245750 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-af5bbdc0-ca42-4111-8cab-6bfa0c5d0058 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:27.246189 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-af5bbdc0-ca42-4111-8cab-6bfa0c5d0058 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:27.250085 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:01:27.378530 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-af5bbdc0-ca42-4111-8cab-6bfa0c5d0058 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:27.386867 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-af5bbdc0-ca42-4111-8cab-6bfa0c5d0058 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:27.388376 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-af5bbdc0-ca42-4111-8cab-6bfa0c5d0058 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:27.389527 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-af5bbdc0-ca42-4111-8cab-6bfa0c5d0058 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1750 microversion: 2.20 time: 0.157317 Jul 30 05:01:27.390093 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 258/484] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:01:27 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1750 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 05:01:27.920820 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-752d5a75-a3c2-428a-815e-0ed9de1d5846 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:27.921437 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-752d5a75-a3c2-428a-815e-0ed9de1d5846 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] [instance: a4f0c48f-08ac-4a62-b5f4-7138c10159cb] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:27.928223 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-752d5a75-a3c2-428a-815e-0ed9de1d5846 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:27.928676 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-752d5a75-a3c2-428a-815e-0ed9de1d5846 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:27.929450 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-752d5a75-a3c2-428a-815e-0ed9de1d5846 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:27.929888 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-752d5a75-a3c2-428a-815e-0ed9de1d5846 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:28.058157 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-752d5a75-a3c2-428a-815e-0ed9de1d5846 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98e41589d15488380a43000a82c2b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f102af4a74e946caa9fefc7ad0ae148c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:28.066033 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-752d5a75-a3c2-428a-815e-0ed9de1d5846 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] 10.222.0.20 "GET /compute/v2.1/servers/a4f0c48f-08ac-4a62-b5f4-7138c10159cb" status: 200 len: 1314 microversion: 2.1 time: 0.149259 Jul 30 05:01:28.066589 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 227/485] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:01:27 2022] GET /compute/v2.1/servers/a4f0c48f-08ac-4a62-b5f4-7138c10159cb => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:01:28.414026 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-a966b2e5-ae70-4057-8201-6e06401bf698 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:28.414765 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-a966b2e5-ae70-4057-8201-6e06401bf698 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:28.421642 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a966b2e5-ae70-4057-8201-6e06401bf698 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:28.422164 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a966b2e5-ae70-4057-8201-6e06401bf698 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:28.423072 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a966b2e5-ae70-4057-8201-6e06401bf698 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:28.423601 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a966b2e5-ae70-4057-8201-6e06401bf698 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:28.534086 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-c40a16b0-1fcb-46a0-9e0e-0c4d7995786c req-c507beee-e9ac-48a4-9e1d-45967e63ab5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4f0c48f-08ac-4a62-b5f4-7138c10159cb", "name": "network-vif-plugged", "status": "completed", "tag": "b6093eab-acff-4f9e-9803-4facdba24732"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:01:28.546647 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-c40a16b0-1fcb-46a0-9e0e-0c4d7995786c req-c507beee-e9ac-48a4-9e1d-45967e63ab5b service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:28.547221 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-c40a16b0-1fcb-46a0-9e0e-0c4d7995786c req-c507beee-e9ac-48a4-9e1d-45967e63ab5b service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:28.559168 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-c40a16b0-1fcb-46a0-9e0e-0c4d7995786c req-c507beee-e9ac-48a4-9e1d-45967e63ab5b service nova] Creating event network-vif-plugged:b6093eab-acff-4f9e-9803-4facdba24732 for instance a4f0c48f-08ac-4a62-b5f4-7138c10159cb on hv-cinder-85127 Jul 30 05:01:28.561278 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-a966b2e5-ae70-4057-8201-6e06401bf698 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:28.564502 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-c40a16b0-1fcb-46a0-9e0e-0c4d7995786c req-c507beee-e9ac-48a4-9e1d-45967e63ab5b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035347 Jul 30 05:01:28.565924 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 228/486] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Jul 30 05:01:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 05:01:28.572169 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-a966b2e5-ae70-4057-8201-6e06401bf698 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:28.573690 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-a966b2e5-ae70-4057-8201-6e06401bf698 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:28.574882 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-a966b2e5-ae70-4057-8201-6e06401bf698 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1752 microversion: 2.20 time: 0.165738 Jul 30 05:01:28.575430 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 259/487] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:01:28 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1752 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 05:01:29.088059 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-7c39975e-9f12-43ca-a2f0-de5285890295 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:29.088699 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-7c39975e-9f12-43ca-a2f0-de5285890295 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] [instance: a4f0c48f-08ac-4a62-b5f4-7138c10159cb] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:29.094887 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7c39975e-9f12-43ca-a2f0-de5285890295 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:29.095348 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7c39975e-9f12-43ca-a2f0-de5285890295 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:29.096247 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7c39975e-9f12-43ca-a2f0-de5285890295 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:29.097208 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7c39975e-9f12-43ca-a2f0-de5285890295 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:29.229416 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-7c39975e-9f12-43ca-a2f0-de5285890295 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98e41589d15488380a43000a82c2b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f102af4a74e946caa9fefc7ad0ae148c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:29.236798 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-7c39975e-9f12-43ca-a2f0-de5285890295 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] 10.222.0.20 "GET /compute/v2.1/servers/a4f0c48f-08ac-4a62-b5f4-7138c10159cb" status: 200 len: 1314 microversion: 2.1 time: 0.153449 Jul 30 05:01:29.237548 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 229/488] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:01:29 2022] GET /compute/v2.1/servers/a4f0c48f-08ac-4a62-b5f4-7138c10159cb => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:01:29.598554 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-48c6f081-7b21-41f7-b677-1ca7885ac540 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:29.599378 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-48c6f081-7b21-41f7-b677-1ca7885ac540 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:29.605698 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-48c6f081-7b21-41f7-b677-1ca7885ac540 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:29.606136 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-48c6f081-7b21-41f7-b677-1ca7885ac540 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:29.606925 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-48c6f081-7b21-41f7-b677-1ca7885ac540 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:29.607519 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-48c6f081-7b21-41f7-b677-1ca7885ac540 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:29.759577 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-48c6f081-7b21-41f7-b677-1ca7885ac540 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:29.768412 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-48c6f081-7b21-41f7-b677-1ca7885ac540 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:29.769918 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-48c6f081-7b21-41f7-b677-1ca7885ac540 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:29.771085 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-48c6f081-7b21-41f7-b677-1ca7885ac540 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1752 microversion: 2.20 time: 0.176747 Jul 30 05:01:29.771641 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 260/489] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:01:29 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1752 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 05:01:30.258968 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-43079e86-d4df-4f89-a6e3-ccb483e5a9ae tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:30.259696 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-43079e86-d4df-4f89-a6e3-ccb483e5a9ae tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] [instance: a4f0c48f-08ac-4a62-b5f4-7138c10159cb] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:30.266583 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-43079e86-d4df-4f89-a6e3-ccb483e5a9ae tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:30.267031 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-43079e86-d4df-4f89-a6e3-ccb483e5a9ae tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:30.267798 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-43079e86-d4df-4f89-a6e3-ccb483e5a9ae tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:30.268383 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-43079e86-d4df-4f89-a6e3-ccb483e5a9ae tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:30.401624 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-43079e86-d4df-4f89-a6e3-ccb483e5a9ae tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98e41589d15488380a43000a82c2b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f102af4a74e946caa9fefc7ad0ae148c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:30.409059 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-43079e86-d4df-4f89-a6e3-ccb483e5a9ae tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] 10.222.0.20 "GET /compute/v2.1/servers/a4f0c48f-08ac-4a62-b5f4-7138c10159cb" status: 200 len: 1314 microversion: 2.1 time: 0.154472 Jul 30 05:01:30.409610 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 230/490] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:01:30 2022] GET /compute/v2.1/servers/a4f0c48f-08ac-4a62-b5f4-7138c10159cb => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:01:30.797223 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-24340a1a-354b-4d3e-92da-105ce75dbe7e tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:30.798641 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-24340a1a-354b-4d3e-92da-105ce75dbe7e tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:30.806238 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-24340a1a-354b-4d3e-92da-105ce75dbe7e tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:30.806679 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-24340a1a-354b-4d3e-92da-105ce75dbe7e tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:30.807793 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-24340a1a-354b-4d3e-92da-105ce75dbe7e tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:30.808242 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-24340a1a-354b-4d3e-92da-105ce75dbe7e tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:30.958255 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-24340a1a-354b-4d3e-92da-105ce75dbe7e tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:30.966899 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-24340a1a-354b-4d3e-92da-105ce75dbe7e tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:30.968396 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-24340a1a-354b-4d3e-92da-105ce75dbe7e tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:30.969542 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-24340a1a-354b-4d3e-92da-105ce75dbe7e tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1808 microversion: 2.20 time: 0.177342 Jul 30 05:01:30.970093 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 261/491] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:01:30 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1808 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 05:01:31.224970 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-de6e6de5-cec5-4fd2-aaf9-44bf7ac69490 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-53987624", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-275234029", "security_groups": [{"name": "tempest-secgroup-smoke-9281366"}], "block_device_mapping_v2": [{"uuid": "76b2ac9a-b7e1-440d-a49d-22fa5f8c737c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "05de52c4-affb-4a9e-aea7-e8e105567377"}]}} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:01:31.336548 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.network.neutron [None req-de6e6de5-cec5-4fd2-aaf9-44bf7ac69490 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] validate_networks() for [('05de52c4-affb-4a9e-aea7-e8e105567377', None, None, None, None, None)] {{(pid=117885) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 05:01:31.430691 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-7087771c-928b-49a0-8830-dd31e663efd3 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:31.431653 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-7087771c-928b-49a0-8830-dd31e663efd3 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] [instance: a4f0c48f-08ac-4a62-b5f4-7138c10159cb] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:31.437864 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7087771c-928b-49a0-8830-dd31e663efd3 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:31.438407 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7087771c-928b-49a0-8830-dd31e663efd3 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:31.439461 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7087771c-928b-49a0-8830-dd31e663efd3 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:31.440770 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7087771c-928b-49a0-8830-dd31e663efd3 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:31.732134 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-de6e6de5-cec5-4fd2-aaf9-44bf7ac69490 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Flavor limits 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 05:01:31.732624 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-de6e6de5-cec5-4fd2-aaf9-44bf7ac69490 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Image limits 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 05:01:31.733164 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-de6e6de5-cec5-4fd2-aaf9-44bf7ac69490 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Flavor pref 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 05:01:31.733978 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-de6e6de5-cec5-4fd2-aaf9-44bf7ac69490 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Image pref 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 05:01:31.734478 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-de6e6de5-cec5-4fd2-aaf9-44bf7ac69490 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 05:01:31.744871 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-de6e6de5-cec5-4fd2-aaf9-44bf7ac69490 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:31.745314 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-de6e6de5-cec5-4fd2-aaf9-44bf7ac69490 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:31.746545 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-de6e6de5-cec5-4fd2-aaf9-44bf7ac69490 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:31.747004 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-de6e6de5-cec5-4fd2-aaf9-44bf7ac69490 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:31.765130 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.quota [None req-de6e6de5-cec5-4fd2-aaf9-44bf7ac69490 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Getting quotas for project db365a6a9f6041a7a8749fd1a1e3d488. Resources: {'ram', 'cores', 'instances'} {{(pid=117885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 05:01:31.769767 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.quota [None req-de6e6de5-cec5-4fd2-aaf9-44bf7ac69490 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Getting quotas for user 407ad282edd74fb1adf62fb63306779c and project db365a6a9f6041a7a8749fd1a1e3d488. Resources: {'ram', 'cores', 'instances'} {{(pid=117885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 05:01:31.834407 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-de6e6de5-cec5-4fd2-aaf9-44bf7ac69490 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Going to run 1 instances... {{(pid=117885) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 05:01:31.836466 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-de6e6de5-cec5-4fd2-aaf9-44bf7ac69490 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] [instance: 267d974a-0a42-4e11-ada0-68e101c4a48f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='76b2ac9a-b7e1-440d-a49d-22fa5f8c737c',volume_size=None,volume_type=None)] {{(pid=117885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 05:01:31.904459 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-7087771c-928b-49a0-8830-dd31e663efd3 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98e41589d15488380a43000a82c2b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f102af4a74e946caa9fefc7ad0ae148c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:31.913636 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-7087771c-928b-49a0-8830-dd31e663efd3 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] 10.222.0.20 "GET /compute/v2.1/servers/a4f0c48f-08ac-4a62-b5f4-7138c10159cb" status: 200 len: 1498 microversion: 2.1 time: 0.486820 Jul 30 05:01:31.914541 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 262/492] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:01:31 2022] GET /compute/v2.1/servers/a4f0c48f-08ac-4a62-b5f4-7138c10159cb => generated 1498 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 05:01:31.980923 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-de6e6de5-cec5-4fd2-aaf9-44bf7ac69490 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.759709 Jul 30 05:01:31.981878 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 231/493] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Jul 30 05:01:31 2022] POST /compute/v2.1/servers => generated 403 bytes in 761 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 05:01:31.993784 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-36385068-0a65-499f-9315-c750893afeea tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:31.994987 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-36385068-0a65-499f-9315-c750893afeea tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:31.995516 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-c35ea69e-2455-49bf-8ea7-24902ca7cec9 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:31.996233 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-c35ea69e-2455-49bf-8ea7-24902ca7cec9 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] [instance: 267d974a-0a42-4e11-ada0-68e101c4a48f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:32.002137 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-36385068-0a65-499f-9315-c750893afeea tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:32.004704 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-36385068-0a65-499f-9315-c750893afeea tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:32.006044 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-36385068-0a65-499f-9315-c750893afeea tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:32.006980 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-36385068-0a65-499f-9315-c750893afeea tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:32.066557 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-c35ea69e-2455-49bf-8ea7-24902ca7cec9 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407ad282edd74fb1adf62fb63306779c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db365a6a9f6041a7a8749fd1a1e3d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:32.074967 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-c35ea69e-2455-49bf-8ea7-24902ca7cec9 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] 10.222.0.20 "GET /compute/v2.1/servers/267d974a-0a42-4e11-ada0-68e101c4a48f" status: 200 len: 1092 microversion: 2.1 time: 0.084996 Jul 30 05:01:32.075533 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 232/494] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:01:31 2022] GET /compute/v2.1/servers/267d974a-0a42-4e11-ada0-68e101c4a48f => generated 1092 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:01:32.194140 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-e391bf49-39db-46ac-8084-3cbe248b60a1 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:32.194890 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-e391bf49-39db-46ac-8084-3cbe248b60a1 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] [instance: fdf672c0-82ac-413b-a8cc-e01a4de45c4e] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:32.203107 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e391bf49-39db-46ac-8084-3cbe248b60a1 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:32.203743 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e391bf49-39db-46ac-8084-3cbe248b60a1 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:32.205963 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e391bf49-39db-46ac-8084-3cbe248b60a1 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:32.207837 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e391bf49-39db-46ac-8084-3cbe248b60a1 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:32.276577 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-36385068-0a65-499f-9315-c750893afeea tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:32.293324 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-36385068-0a65-499f-9315-c750893afeea tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:32.295219 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-36385068-0a65-499f-9315-c750893afeea tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:32.296904 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-36385068-0a65-499f-9315-c750893afeea tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1808 microversion: 2.20 time: 0.308640 Jul 30 05:01:32.298125 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 263/495] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:01:31 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1808 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 05:01:32.378597 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.objects.instance [None req-e391bf49-39db-46ac-8084-3cbe248b60a1 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lazy-loading 'services' on Instance uuid fdf672c0-82ac-413b-a8cc-e01a4de45c4e {{(pid=117885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 05:01:32.535939 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-e391bf49-39db-46ac-8084-3cbe248b60a1 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] 10.222.0.20 "DELETE /compute/v2.1/servers/fdf672c0-82ac-413b-a8cc-e01a4de45c4e/os-volume_attachments/32d6af20-5226-430f-add4-ed86c255a0a5" status: 202 len: 0 microversion: 2.1 time: 0.346372 Jul 30 05:01:32.536580 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 233/496] 10.222.0.20 () {58 vars in 1416 bytes} [Sat Jul 30 05:01:32 2022] DELETE /compute/v2.1/servers/fdf672c0-82ac-413b-a8cc-e01a4de45c4e/os-volume_attachments/32d6af20-5226-430f-add4-ed86c255a0a5 => generated 0 bytes in 348 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 30 05:01:32.594517 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-17c48eec-19a0-4258-825d-6ba7354e802f tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:32.595019 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-17c48eec-19a0-4258-825d-6ba7354e802f tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] [instance: a4f0c48f-08ac-4a62-b5f4-7138c10159cb] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:32.612355 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-17c48eec-19a0-4258-825d-6ba7354e802f tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:32.615210 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-17c48eec-19a0-4258-825d-6ba7354e802f tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:32.616174 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-17c48eec-19a0-4258-825d-6ba7354e802f tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:32.616689 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-17c48eec-19a0-4258-825d-6ba7354e802f tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:32.641520 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-17c48eec-19a0-4258-825d-6ba7354e802f tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] [instance: a4f0c48f-08ac-4a62-b5f4-7138c10159cb] Going to try to terminate instance {{(pid=117886) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 05:01:32.716142 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-17c48eec-19a0-4258-825d-6ba7354e802f tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a4f0c48f-08ac-4a62-b5f4-7138c10159cb" status: 204 len: 0 microversion: 2.1 time: 0.125523 Jul 30 05:01:32.716727 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 264/497] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Jul 30 05:01:32 2022] DELETE /compute/v2.1/servers/a4f0c48f-08ac-4a62-b5f4-7138c10159cb => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 05:01:32.726628 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-94aaf7cd-61bf-4736-a434-a5eee2abc651 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:32.727363 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-94aaf7cd-61bf-4736-a434-a5eee2abc651 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] [instance: a4f0c48f-08ac-4a62-b5f4-7138c10159cb] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:32.733833 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-94aaf7cd-61bf-4736-a434-a5eee2abc651 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:32.734288 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-94aaf7cd-61bf-4736-a434-a5eee2abc651 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:32.735238 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-94aaf7cd-61bf-4736-a434-a5eee2abc651 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:32.735986 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-94aaf7cd-61bf-4736-a434-a5eee2abc651 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:32.866873 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-94aaf7cd-61bf-4736-a434-a5eee2abc651 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98e41589d15488380a43000a82c2b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f102af4a74e946caa9fefc7ad0ae148c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:32.874535 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-94aaf7cd-61bf-4736-a434-a5eee2abc651 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] 10.222.0.20 "GET /compute/v2.1/servers/a4f0c48f-08ac-4a62-b5f4-7138c10159cb" status: 200 len: 1504 microversion: 2.1 time: 0.152123 Jul 30 05:01:32.875097 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 234/498] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:01:32 2022] GET /compute/v2.1/servers/a4f0c48f-08ac-4a62-b5f4-7138c10159cb => generated 1504 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 05:01:33.098037 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-621f632f-f0a6-4a69-b99f-0201f10166bd tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:33.098780 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-621f632f-f0a6-4a69-b99f-0201f10166bd tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] [instance: 267d974a-0a42-4e11-ada0-68e101c4a48f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:33.105198 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-621f632f-f0a6-4a69-b99f-0201f10166bd tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:33.105648 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-621f632f-f0a6-4a69-b99f-0201f10166bd tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:33.106411 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-621f632f-f0a6-4a69-b99f-0201f10166bd tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:33.106873 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-621f632f-f0a6-4a69-b99f-0201f10166bd tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:33.168958 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-621f632f-f0a6-4a69-b99f-0201f10166bd tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407ad282edd74fb1adf62fb63306779c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db365a6a9f6041a7a8749fd1a1e3d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:33.177100 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-621f632f-f0a6-4a69-b99f-0201f10166bd tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] 10.222.0.20 "GET /compute/v2.1/servers/267d974a-0a42-4e11-ada0-68e101c4a48f" status: 200 len: 1134 microversion: 2.1 time: 0.083942 Jul 30 05:01:33.177661 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 265/499] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:01:33 2022] GET /compute/v2.1/servers/267d974a-0a42-4e11-ada0-68e101c4a48f => generated 1134 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:01:33.322264 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-1d63d8d0-eac0-4393-885d-c2b161651aeb tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:33.322816 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-1d63d8d0-eac0-4393-885d-c2b161651aeb tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:33.329196 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1d63d8d0-eac0-4393-885d-c2b161651aeb tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:33.329645 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1d63d8d0-eac0-4393-885d-c2b161651aeb tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:33.330479 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1d63d8d0-eac0-4393-885d-c2b161651aeb tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:33.330912 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1d63d8d0-eac0-4393-885d-c2b161651aeb tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:33.463869 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-1d63d8d0-eac0-4393-885d-c2b161651aeb tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:33.472106 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-1d63d8d0-eac0-4393-885d-c2b161651aeb tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:33.473650 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-1d63d8d0-eac0-4393-885d-c2b161651aeb tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:33.474829 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-1d63d8d0-eac0-4393-885d-c2b161651aeb tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1808 microversion: 2.20 time: 0.156461 Jul 30 05:01:33.475407 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 235/500] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:01:33 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 05:01:33.895776 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-8610397c-39c2-425c-a447-178b4ba7bb56 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:33.896346 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-8610397c-39c2-425c-a447-178b4ba7bb56 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] [instance: a4f0c48f-08ac-4a62-b5f4-7138c10159cb] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:33.902428 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8610397c-39c2-425c-a447-178b4ba7bb56 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:33.902901 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8610397c-39c2-425c-a447-178b4ba7bb56 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:33.903653 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8610397c-39c2-425c-a447-178b4ba7bb56 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:33.904084 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8610397c-39c2-425c-a447-178b4ba7bb56 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:34.035074 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-8610397c-39c2-425c-a447-178b4ba7bb56 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98e41589d15488380a43000a82c2b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f102af4a74e946caa9fefc7ad0ae148c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:34.042305 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-8610397c-39c2-425c-a447-178b4ba7bb56 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] 10.222.0.20 "GET /compute/v2.1/servers/a4f0c48f-08ac-4a62-b5f4-7138c10159cb" status: 200 len: 1504 microversion: 2.1 time: 0.150484 Jul 30 05:01:34.042890 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 266/501] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:01:33 2022] GET /compute/v2.1/servers/a4f0c48f-08ac-4a62-b5f4-7138c10159cb => generated 1504 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:01:34.199133 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-c4b8d2bf-223f-4e90-a8f9-da10967afe5d tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:34.199664 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-c4b8d2bf-223f-4e90-a8f9-da10967afe5d tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] [instance: 267d974a-0a42-4e11-ada0-68e101c4a48f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:34.205846 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c4b8d2bf-223f-4e90-a8f9-da10967afe5d tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:34.206290 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c4b8d2bf-223f-4e90-a8f9-da10967afe5d tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:34.207086 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c4b8d2bf-223f-4e90-a8f9-da10967afe5d tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:34.207516 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c4b8d2bf-223f-4e90-a8f9-da10967afe5d tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:34.275811 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-c4b8d2bf-223f-4e90-a8f9-da10967afe5d tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407ad282edd74fb1adf62fb63306779c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db365a6a9f6041a7a8749fd1a1e3d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:34.283560 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-c4b8d2bf-223f-4e90-a8f9-da10967afe5d tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] 10.222.0.20 "GET /compute/v2.1/servers/267d974a-0a42-4e11-ada0-68e101c4a48f" status: 200 len: 1134 microversion: 2.1 time: 0.088922 Jul 30 05:01:34.296937 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 236/502] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:01:34 2022] GET /compute/v2.1/servers/267d974a-0a42-4e11-ada0-68e101c4a48f => generated 1134 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:01:34.498181 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-e43a26cf-c784-4bda-805a-350c54085e83 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:34.498825 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-e43a26cf-c784-4bda-805a-350c54085e83 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:34.505501 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e43a26cf-c784-4bda-805a-350c54085e83 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:34.505950 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e43a26cf-c784-4bda-805a-350c54085e83 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:34.506844 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e43a26cf-c784-4bda-805a-350c54085e83 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:34.507302 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e43a26cf-c784-4bda-805a-350c54085e83 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:34.655327 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-e43a26cf-c784-4bda-805a-350c54085e83 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:34.664891 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-e43a26cf-c784-4bda-805a-350c54085e83 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:34.667365 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-e43a26cf-c784-4bda-805a-350c54085e83 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:34.676250 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-e43a26cf-c784-4bda-805a-350c54085e83 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1808 microversion: 2.20 time: 0.181695 Jul 30 05:01:34.677173 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 267/503] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:01:34 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1808 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 05:01:35.064670 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-f112c6a4-27e8-4dcc-a951-f4befebe1e91 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:35.065793 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-f112c6a4-27e8-4dcc-a951-f4befebe1e91 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] [instance: a4f0c48f-08ac-4a62-b5f4-7138c10159cb] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:35.072520 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f112c6a4-27e8-4dcc-a951-f4befebe1e91 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:35.072970 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f112c6a4-27e8-4dcc-a951-f4befebe1e91 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:35.073743 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f112c6a4-27e8-4dcc-a951-f4befebe1e91 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:35.074180 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f112c6a4-27e8-4dcc-a951-f4befebe1e91 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:35.217391 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-f112c6a4-27e8-4dcc-a951-f4befebe1e91 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98e41589d15488380a43000a82c2b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f102af4a74e946caa9fefc7ad0ae148c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:35.225508 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-f112c6a4-27e8-4dcc-a951-f4befebe1e91 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] 10.222.0.20 "GET /compute/v2.1/servers/a4f0c48f-08ac-4a62-b5f4-7138c10159cb" status: 200 len: 1504 microversion: 2.1 time: 0.164688 Jul 30 05:01:35.226066 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 237/504] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:01:35 2022] GET /compute/v2.1/servers/a4f0c48f-08ac-4a62-b5f4-7138c10159cb => generated 1504 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:01:35.305341 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-cab07b27-c6fb-439a-9686-3ecd12da8204 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:35.305870 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-cab07b27-c6fb-439a-9686-3ecd12da8204 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] [instance: 267d974a-0a42-4e11-ada0-68e101c4a48f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:35.311940 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cab07b27-c6fb-439a-9686-3ecd12da8204 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:35.312399 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cab07b27-c6fb-439a-9686-3ecd12da8204 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:35.313161 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cab07b27-c6fb-439a-9686-3ecd12da8204 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:35.313597 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cab07b27-c6fb-439a-9686-3ecd12da8204 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:35.378793 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-cab07b27-c6fb-439a-9686-3ecd12da8204 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407ad282edd74fb1adf62fb63306779c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db365a6a9f6041a7a8749fd1a1e3d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:35.386273 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-cab07b27-c6fb-439a-9686-3ecd12da8204 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] 10.222.0.20 "GET /compute/v2.1/servers/267d974a-0a42-4e11-ada0-68e101c4a48f" status: 200 len: 1190 microversion: 2.1 time: 0.084881 Jul 30 05:01:35.386855 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 268/505] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:01:35 2022] GET /compute/v2.1/servers/267d974a-0a42-4e11-ada0-68e101c4a48f => generated 1190 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:01:35.700918 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-f5718b76-ac12-416e-ba33-5d38102e42b0 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:35.701577 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-f5718b76-ac12-416e-ba33-5d38102e42b0 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:35.709357 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f5718b76-ac12-416e-ba33-5d38102e42b0 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:35.709801 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f5718b76-ac12-416e-ba33-5d38102e42b0 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:35.710595 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f5718b76-ac12-416e-ba33-5d38102e42b0 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:35.711031 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f5718b76-ac12-416e-ba33-5d38102e42b0 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:35.878107 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-f5718b76-ac12-416e-ba33-5d38102e42b0 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:35.887124 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-f5718b76-ac12-416e-ba33-5d38102e42b0 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:35.889044 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-f5718b76-ac12-416e-ba33-5d38102e42b0 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:35.890431 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-f5718b76-ac12-416e-ba33-5d38102e42b0 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1808 microversion: 2.20 time: 0.193484 Jul 30 05:01:35.891502 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 238/506] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:01:35 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1808 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 05:01:36.259382 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-0e8c45b3-5cf5-461a-9b5f-ced73325f513 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:36.260053 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-0e8c45b3-5cf5-461a-9b5f-ced73325f513 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] [instance: a4f0c48f-08ac-4a62-b5f4-7138c10159cb] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:36.266738 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0e8c45b3-5cf5-461a-9b5f-ced73325f513 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:36.267185 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0e8c45b3-5cf5-461a-9b5f-ced73325f513 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:36.268587 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0e8c45b3-5cf5-461a-9b5f-ced73325f513 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:36.269027 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0e8c45b3-5cf5-461a-9b5f-ced73325f513 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:36.407525 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-925d93b0-b5e3-47e9-9e09-0ba544d310a1 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:36.408058 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-925d93b0-b5e3-47e9-9e09-0ba544d310a1 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] [instance: 267d974a-0a42-4e11-ada0-68e101c4a48f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:36.410185 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-0e8c45b3-5cf5-461a-9b5f-ced73325f513 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98e41589d15488380a43000a82c2b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f102af4a74e946caa9fefc7ad0ae148c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:36.414866 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-925d93b0-b5e3-47e9-9e09-0ba544d310a1 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:36.415323 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-925d93b0-b5e3-47e9-9e09-0ba544d310a1 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:36.416101 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-925d93b0-b5e3-47e9-9e09-0ba544d310a1 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:36.416540 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-925d93b0-b5e3-47e9-9e09-0ba544d310a1 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:36.417937 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-0e8c45b3-5cf5-461a-9b5f-ced73325f513 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] 10.222.0.20 "GET /compute/v2.1/servers/a4f0c48f-08ac-4a62-b5f4-7138c10159cb" status: 200 len: 1504 microversion: 2.1 time: 0.162371 Jul 30 05:01:36.418526 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 269/507] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:01:36 2022] GET /compute/v2.1/servers/a4f0c48f-08ac-4a62-b5f4-7138c10159cb => generated 1504 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:01:36.487308 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-925d93b0-b5e3-47e9-9e09-0ba544d310a1 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407ad282edd74fb1adf62fb63306779c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db365a6a9f6041a7a8749fd1a1e3d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:36.496466 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-925d93b0-b5e3-47e9-9e09-0ba544d310a1 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] 10.222.0.20 "GET /compute/v2.1/servers/267d974a-0a42-4e11-ada0-68e101c4a48f" status: 200 len: 1190 microversion: 2.1 time: 0.092644 Jul 30 05:01:36.497478 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 239/508] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:01:36 2022] GET /compute/v2.1/servers/267d974a-0a42-4e11-ada0-68e101c4a48f => generated 1190 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:01:36.915861 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-e737523b-2e3a-480c-b6b6-f2010e612a01 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:36.916872 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-e737523b-2e3a-480c-b6b6-f2010e612a01 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:36.923381 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e737523b-2e3a-480c-b6b6-f2010e612a01 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:36.923829 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e737523b-2e3a-480c-b6b6-f2010e612a01 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:36.925175 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e737523b-2e3a-480c-b6b6-f2010e612a01 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:36.925612 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e737523b-2e3a-480c-b6b6-f2010e612a01 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:37.063602 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-e737523b-2e3a-480c-b6b6-f2010e612a01 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:37.073223 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-e737523b-2e3a-480c-b6b6-f2010e612a01 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:37.074754 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-e737523b-2e3a-480c-b6b6-f2010e612a01 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:37.075909 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-e737523b-2e3a-480c-b6b6-f2010e612a01 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1808 microversion: 2.20 time: 0.164153 Jul 30 05:01:37.076464 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 270/509] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:01:36 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 05:01:37.438329 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-5134ddf0-9154-4ab2-9cde-6ac3c94cc366 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:37.438994 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-5134ddf0-9154-4ab2-9cde-6ac3c94cc366 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] [instance: a4f0c48f-08ac-4a62-b5f4-7138c10159cb] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:37.445437 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5134ddf0-9154-4ab2-9cde-6ac3c94cc366 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:37.445884 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5134ddf0-9154-4ab2-9cde-6ac3c94cc366 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:37.446664 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5134ddf0-9154-4ab2-9cde-6ac3c94cc366 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:37.447095 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5134ddf0-9154-4ab2-9cde-6ac3c94cc366 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:37.520986 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-44c33dfe-c791-40b3-9569-a5def00f4000 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:37.530011 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-44c33dfe-c791-40b3-9569-a5def00f4000 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] [instance: 267d974a-0a42-4e11-ada0-68e101c4a48f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:37.539786 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-44c33dfe-c791-40b3-9569-a5def00f4000 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:37.540267 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-44c33dfe-c791-40b3-9569-a5def00f4000 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:37.541039 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-44c33dfe-c791-40b3-9569-a5def00f4000 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:37.541470 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-44c33dfe-c791-40b3-9569-a5def00f4000 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:37.595484 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-5134ddf0-9154-4ab2-9cde-6ac3c94cc366 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98e41589d15488380a43000a82c2b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f102af4a74e946caa9fefc7ad0ae148c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:37.605132 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:01:37.608324 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-5134ddf0-9154-4ab2-9cde-6ac3c94cc366 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] 10.222.0.20 "GET /compute/v2.1/servers/a4f0c48f-08ac-4a62-b5f4-7138c10159cb" status: 200 len: 1504 microversion: 2.1 time: 0.173794 Jul 30 05:01:37.609463 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 240/510] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:01:37 2022] GET /compute/v2.1/servers/a4f0c48f-08ac-4a62-b5f4-7138c10159cb => generated 1504 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:01:37.663613 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-44c33dfe-c791-40b3-9569-a5def00f4000 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407ad282edd74fb1adf62fb63306779c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db365a6a9f6041a7a8749fd1a1e3d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:37.672092 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-44c33dfe-c791-40b3-9569-a5def00f4000 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] 10.222.0.20 "GET /compute/v2.1/servers/267d974a-0a42-4e11-ada0-68e101c4a48f" status: 200 len: 1190 microversion: 2.1 time: 0.158618 Jul 30 05:01:37.672871 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 271/511] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:01:37 2022] GET /compute/v2.1/servers/267d974a-0a42-4e11-ada0-68e101c4a48f => generated 1190 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:01:38.101000 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-b8a5173d-c18f-40bb-8822-d155f5c6fbf8 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:38.101603 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-b8a5173d-c18f-40bb-8822-d155f5c6fbf8 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:38.108807 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b8a5173d-c18f-40bb-8822-d155f5c6fbf8 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:38.109257 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b8a5173d-c18f-40bb-8822-d155f5c6fbf8 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:38.110024 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b8a5173d-c18f-40bb-8822-d155f5c6fbf8 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:38.110473 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b8a5173d-c18f-40bb-8822-d155f5c6fbf8 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:38.254403 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-b8a5173d-c18f-40bb-8822-d155f5c6fbf8 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:38.262771 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-b8a5173d-c18f-40bb-8822-d155f5c6fbf8 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:38.264268 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-b8a5173d-c18f-40bb-8822-d155f5c6fbf8 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:38.265414 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-b8a5173d-c18f-40bb-8822-d155f5c6fbf8 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1808 microversion: 2.20 time: 0.168290 Jul 30 05:01:38.265973 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 241/512] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:01:38 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 05:01:38.571655 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-6d7d366b-5c7f-41da-91b9-517397e0d364 req-9131ba48-690a-410f-8d83-cef4c8850bec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4f0c48f-08ac-4a62-b5f4-7138c10159cb", "name": "network-vif-unplugged", "status": "completed", "tag": "b6093eab-acff-4f9e-9803-4facdba24732"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:01:38.582005 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-6d7d366b-5c7f-41da-91b9-517397e0d364 req-9131ba48-690a-410f-8d83-cef4c8850bec service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:38.582584 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-6d7d366b-5c7f-41da-91b9-517397e0d364 req-9131ba48-690a-410f-8d83-cef4c8850bec service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:38.593183 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-6d7d366b-5c7f-41da-91b9-517397e0d364 req-9131ba48-690a-410f-8d83-cef4c8850bec service nova] Creating event network-vif-unplugged:b6093eab-acff-4f9e-9803-4facdba24732 for instance a4f0c48f-08ac-4a62-b5f4-7138c10159cb on hv-cinder-85127 Jul 30 05:01:38.599034 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-6d7d366b-5c7f-41da-91b9-517397e0d364 req-9131ba48-690a-410f-8d83-cef4c8850bec service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031577 Jul 30 05:01:38.600050 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 272/513] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Jul 30 05:01:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 05:01:38.629296 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-926dcb55-0fda-4858-94a6-9cf3c08b2d3b tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:38.629917 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-926dcb55-0fda-4858-94a6-9cf3c08b2d3b tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] [instance: a4f0c48f-08ac-4a62-b5f4-7138c10159cb] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:38.636421 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-926dcb55-0fda-4858-94a6-9cf3c08b2d3b tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:38.636870 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-926dcb55-0fda-4858-94a6-9cf3c08b2d3b tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:38.637634 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-926dcb55-0fda-4858-94a6-9cf3c08b2d3b tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:38.638074 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-926dcb55-0fda-4858-94a6-9cf3c08b2d3b tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:38.694387 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-85b20456-7afc-426c-abc4-16dab57adb4f tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:38.695452 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-85b20456-7afc-426c-abc4-16dab57adb4f tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] [instance: 267d974a-0a42-4e11-ada0-68e101c4a48f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:38.702998 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-85b20456-7afc-426c-abc4-16dab57adb4f tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:38.703577 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-85b20456-7afc-426c-abc4-16dab57adb4f tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:38.704454 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-85b20456-7afc-426c-abc4-16dab57adb4f tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:38.704957 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-85b20456-7afc-426c-abc4-16dab57adb4f tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:38.775617 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-85b20456-7afc-426c-abc4-16dab57adb4f tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407ad282edd74fb1adf62fb63306779c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db365a6a9f6041a7a8749fd1a1e3d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:38.779986 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:01:38.781843 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-926dcb55-0fda-4858-94a6-9cf3c08b2d3b tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98e41589d15488380a43000a82c2b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f102af4a74e946caa9fefc7ad0ae148c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:38.785206 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-85b20456-7afc-426c-abc4-16dab57adb4f tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] 10.222.0.20 "GET /compute/v2.1/servers/267d974a-0a42-4e11-ada0-68e101c4a48f" status: 200 len: 1190 microversion: 2.1 time: 0.095568 Jul 30 05:01:38.785785 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 273/514] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:01:38 2022] GET /compute/v2.1/servers/267d974a-0a42-4e11-ada0-68e101c4a48f => generated 1190 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 05:01:38.795053 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-926dcb55-0fda-4858-94a6-9cf3c08b2d3b tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] 10.222.0.20 "GET /compute/v2.1/servers/a4f0c48f-08ac-4a62-b5f4-7138c10159cb" status: 200 len: 1504 microversion: 2.1 time: 0.169212 Jul 30 05:01:38.796398 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 242/515] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:01:38 2022] GET /compute/v2.1/servers/a4f0c48f-08ac-4a62-b5f4-7138c10159cb => generated 1504 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:01:39.296014 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-e422c611-6c9f-4a01-be3d-db68cdb74ded tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:39.297090 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-e422c611-6c9f-4a01-be3d-db68cdb74ded tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:39.305983 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e422c611-6c9f-4a01-be3d-db68cdb74ded tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:39.306599 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e422c611-6c9f-4a01-be3d-db68cdb74ded tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:39.307449 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e422c611-6c9f-4a01-be3d-db68cdb74ded tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:39.307962 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e422c611-6c9f-4a01-be3d-db68cdb74ded tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:39.447935 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-e422c611-6c9f-4a01-be3d-db68cdb74ded tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:39.456989 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-e422c611-6c9f-4a01-be3d-db68cdb74ded tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:39.458529 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-e422c611-6c9f-4a01-be3d-db68cdb74ded tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:39.459696 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-e422c611-6c9f-4a01-be3d-db68cdb74ded tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1808 microversion: 2.20 time: 0.171953 Jul 30 05:01:39.460254 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 274/516] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:01:39 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 05:01:39.806405 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-9e1e1cb2-edb5-4027-ab14-d7fda765d460 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:39.807155 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-9e1e1cb2-edb5-4027-ab14-d7fda765d460 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] [instance: 267d974a-0a42-4e11-ada0-68e101c4a48f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:39.813569 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9e1e1cb2-edb5-4027-ab14-d7fda765d460 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:39.814013 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9e1e1cb2-edb5-4027-ab14-d7fda765d460 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:39.814954 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9e1e1cb2-edb5-4027-ab14-d7fda765d460 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:39.815394 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9e1e1cb2-edb5-4027-ab14-d7fda765d460 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:39.817576 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-7286532f-b980-47cf-aabd-cdced620c69c tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:39.818264 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-7286532f-b980-47cf-aabd-cdced620c69c tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] [instance: a4f0c48f-08ac-4a62-b5f4-7138c10159cb] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:39.824697 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7286532f-b980-47cf-aabd-cdced620c69c tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:39.825142 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7286532f-b980-47cf-aabd-cdced620c69c tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:39.825901 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7286532f-b980-47cf-aabd-cdced620c69c tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:39.826536 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7286532f-b980-47cf-aabd-cdced620c69c tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:39.892415 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-9e1e1cb2-edb5-4027-ab14-d7fda765d460 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407ad282edd74fb1adf62fb63306779c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db365a6a9f6041a7a8749fd1a1e3d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:39.902217 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-9e1e1cb2-edb5-4027-ab14-d7fda765d460 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] 10.222.0.20 "GET /compute/v2.1/servers/267d974a-0a42-4e11-ada0-68e101c4a48f" status: 200 len: 1190 microversion: 2.1 time: 0.099538 Jul 30 05:01:39.902979 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 243/517] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:01:39 2022] GET /compute/v2.1/servers/267d974a-0a42-4e11-ada0-68e101c4a48f => generated 1190 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:01:39.993293 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-7286532f-b980-47cf-aabd-cdced620c69c tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98e41589d15488380a43000a82c2b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f102af4a74e946caa9fefc7ad0ae148c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:40.001039 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-7286532f-b980-47cf-aabd-cdced620c69c tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] 10.222.0.20 "GET /compute/v2.1/servers/a4f0c48f-08ac-4a62-b5f4-7138c10159cb" status: 200 len: 1504 microversion: 2.1 time: 0.187816 Jul 30 05:01:40.001705 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 275/518] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:01:39 2022] GET /compute/v2.1/servers/a4f0c48f-08ac-4a62-b5f4-7138c10159cb => generated 1504 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 05:01:40.482794 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-df185f07-44f3-44c5-9de1-a9fb45222043 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:40.483407 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-df185f07-44f3-44c5-9de1-a9fb45222043 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:40.485244 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:01:40.491073 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-df185f07-44f3-44c5-9de1-a9fb45222043 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:40.491528 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-df185f07-44f3-44c5-9de1-a9fb45222043 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:40.492305 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-df185f07-44f3-44c5-9de1-a9fb45222043 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:40.492743 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-df185f07-44f3-44c5-9de1-a9fb45222043 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:40.640207 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-df185f07-44f3-44c5-9de1-a9fb45222043 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:40.649561 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-df185f07-44f3-44c5-9de1-a9fb45222043 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:40.651129 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-df185f07-44f3-44c5-9de1-a9fb45222043 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:40.652302 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-df185f07-44f3-44c5-9de1-a9fb45222043 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1808 microversion: 2.20 time: 0.173477 Jul 30 05:01:40.652868 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 244/519] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:01:40 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1808 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 05:01:40.925096 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-d4e60fd9-3bc4-46c8-836e-4c7c02880f0d tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:40.925787 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-d4e60fd9-3bc4-46c8-836e-4c7c02880f0d tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] [instance: 267d974a-0a42-4e11-ada0-68e101c4a48f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:40.932338 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d4e60fd9-3bc4-46c8-836e-4c7c02880f0d tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:40.932792 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d4e60fd9-3bc4-46c8-836e-4c7c02880f0d tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:40.933562 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d4e60fd9-3bc4-46c8-836e-4c7c02880f0d tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:40.934001 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d4e60fd9-3bc4-46c8-836e-4c7c02880f0d tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:41.003388 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-d4e60fd9-3bc4-46c8-836e-4c7c02880f0d tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407ad282edd74fb1adf62fb63306779c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db365a6a9f6041a7a8749fd1a1e3d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:41.011245 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-d4e60fd9-3bc4-46c8-836e-4c7c02880f0d tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] 10.222.0.20 "GET /compute/v2.1/servers/267d974a-0a42-4e11-ada0-68e101c4a48f" status: 200 len: 1190 microversion: 2.1 time: 0.091100 Jul 30 05:01:41.012181 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 276/520] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:01:40 2022] GET /compute/v2.1/servers/267d974a-0a42-4e11-ada0-68e101c4a48f => generated 1190 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:01:41.023109 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-01accd13-ee58-401e-9667-818875d8cc4f tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:41.024004 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-01accd13-ee58-401e-9667-818875d8cc4f tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] [instance: a4f0c48f-08ac-4a62-b5f4-7138c10159cb] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:41.030733 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-01accd13-ee58-401e-9667-818875d8cc4f tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:41.031190 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-01accd13-ee58-401e-9667-818875d8cc4f tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:41.031967 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-01accd13-ee58-401e-9667-818875d8cc4f tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:41.032411 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-01accd13-ee58-401e-9667-818875d8cc4f tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:41.175796 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-01accd13-ee58-401e-9667-818875d8cc4f tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98e41589d15488380a43000a82c2b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f102af4a74e946caa9fefc7ad0ae148c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:41.183293 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-01accd13-ee58-401e-9667-818875d8cc4f tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] 10.222.0.20 "GET /compute/v2.1/servers/a4f0c48f-08ac-4a62-b5f4-7138c10159cb" status: 200 len: 1504 microversion: 2.1 time: 0.164010 Jul 30 05:01:41.183845 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 245/521] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:01:41 2022] GET /compute/v2.1/servers/a4f0c48f-08ac-4a62-b5f4-7138c10159cb => generated 1504 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 05:01:41.676491 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-c315695f-78c9-43b3-92cc-20176e47c6e0 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:41.677193 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-c315695f-78c9-43b3-92cc-20176e47c6e0 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:41.683352 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c315695f-78c9-43b3-92cc-20176e47c6e0 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:41.683799 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c315695f-78c9-43b3-92cc-20176e47c6e0 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:41.684570 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c315695f-78c9-43b3-92cc-20176e47c6e0 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:41.685016 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c315695f-78c9-43b3-92cc-20176e47c6e0 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:41.823402 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-c315695f-78c9-43b3-92cc-20176e47c6e0 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:41.833577 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-c315695f-78c9-43b3-92cc-20176e47c6e0 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:41.835310 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-c315695f-78c9-43b3-92cc-20176e47c6e0 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:41.836974 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-c315695f-78c9-43b3-92cc-20176e47c6e0 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1808 microversion: 2.20 time: 0.164516 Jul 30 05:01:41.837696 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 277/522] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:01:41 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 05:01:42.033122 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-375435b5-d94f-495e-9fdc-ce645ffe17fc tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:42.034218 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-375435b5-d94f-495e-9fdc-ce645ffe17fc tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] [instance: 267d974a-0a42-4e11-ada0-68e101c4a48f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:42.036421 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell0:SELECT=2 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:01:42.042482 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-375435b5-d94f-495e-9fdc-ce645ffe17fc tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:42.042942 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-375435b5-d94f-495e-9fdc-ce645ffe17fc tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:42.043723 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-375435b5-d94f-495e-9fdc-ce645ffe17fc tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:42.044165 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-375435b5-d94f-495e-9fdc-ce645ffe17fc tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:42.070224 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell0:SELECT=8 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:01:42.114707 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-375435b5-d94f-495e-9fdc-ce645ffe17fc tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407ad282edd74fb1adf62fb63306779c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db365a6a9f6041a7a8749fd1a1e3d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:42.122317 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-375435b5-d94f-495e-9fdc-ce645ffe17fc tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] 10.222.0.20 "GET /compute/v2.1/servers/267d974a-0a42-4e11-ada0-68e101c4a48f" status: 200 len: 1190 microversion: 2.1 time: 0.093312 Jul 30 05:01:42.122926 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 246/523] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:01:42 2022] GET /compute/v2.1/servers/267d974a-0a42-4e11-ada0-68e101c4a48f => generated 1190 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:01:42.212974 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-cb5fd21e-e61e-43e7-b796-58b7475785ab tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:42.213595 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-cb5fd21e-e61e-43e7-b796-58b7475785ab tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] [instance: a4f0c48f-08ac-4a62-b5f4-7138c10159cb] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:42.220154 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cb5fd21e-e61e-43e7-b796-58b7475785ab tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:42.220601 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cb5fd21e-e61e-43e7-b796-58b7475785ab tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:42.221979 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cb5fd21e-e61e-43e7-b796-58b7475785ab tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:42.222414 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cb5fd21e-e61e-43e7-b796-58b7475785ab tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:42.359053 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-cb5fd21e-e61e-43e7-b796-58b7475785ab tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98e41589d15488380a43000a82c2b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f102af4a74e946caa9fefc7ad0ae148c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:42.366641 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-cb5fd21e-e61e-43e7-b796-58b7475785ab tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] 10.222.0.20 "GET /compute/v2.1/servers/a4f0c48f-08ac-4a62-b5f4-7138c10159cb" status: 200 len: 1504 microversion: 2.1 time: 0.158788 Jul 30 05:01:42.367212 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 278/524] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:01:42 2022] GET /compute/v2.1/servers/a4f0c48f-08ac-4a62-b5f4-7138c10159cb => generated 1504 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:01:42.861339 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-2bf57f5c-6baf-40e2-8183-86dda3feaa57 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:42.862805 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-2bf57f5c-6baf-40e2-8183-86dda3feaa57 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:42.869789 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2bf57f5c-6baf-40e2-8183-86dda3feaa57 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:42.870240 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2bf57f5c-6baf-40e2-8183-86dda3feaa57 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:42.871674 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2bf57f5c-6baf-40e2-8183-86dda3feaa57 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:42.872118 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2bf57f5c-6baf-40e2-8183-86dda3feaa57 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:43.011825 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-2bf57f5c-6baf-40e2-8183-86dda3feaa57 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:43.020957 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-2bf57f5c-6baf-40e2-8183-86dda3feaa57 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:43.022715 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-2bf57f5c-6baf-40e2-8183-86dda3feaa57 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:43.024065 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-2bf57f5c-6baf-40e2-8183-86dda3feaa57 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1808 microversion: 2.20 time: 0.166868 Jul 30 05:01:43.025144 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 247/525] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:01:42 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 05:01:43.144105 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-072dc1f9-4ff1-4714-8a5c-3bcc39c70dc1 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:43.144695 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-072dc1f9-4ff1-4714-8a5c-3bcc39c70dc1 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] [instance: 267d974a-0a42-4e11-ada0-68e101c4a48f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:43.150980 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-072dc1f9-4ff1-4714-8a5c-3bcc39c70dc1 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:43.151435 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-072dc1f9-4ff1-4714-8a5c-3bcc39c70dc1 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:43.152206 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-072dc1f9-4ff1-4714-8a5c-3bcc39c70dc1 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:43.152639 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-072dc1f9-4ff1-4714-8a5c-3bcc39c70dc1 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:43.228830 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-072dc1f9-4ff1-4714-8a5c-3bcc39c70dc1 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407ad282edd74fb1adf62fb63306779c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db365a6a9f6041a7a8749fd1a1e3d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:43.239320 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-072dc1f9-4ff1-4714-8a5c-3bcc39c70dc1 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] 10.222.0.20 "GET /compute/v2.1/servers/267d974a-0a42-4e11-ada0-68e101c4a48f" status: 200 len: 1190 microversion: 2.1 time: 0.099097 Jul 30 05:01:43.239909 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 279/526] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:01:43 2022] GET /compute/v2.1/servers/267d974a-0a42-4e11-ada0-68e101c4a48f => generated 1190 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:01:43.388263 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-4aaee063-e00c-4573-a1fc-cd647855fc44 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:43.388875 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-4aaee063-e00c-4573-a1fc-cd647855fc44 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] [instance: a4f0c48f-08ac-4a62-b5f4-7138c10159cb] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:43.396094 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4aaee063-e00c-4573-a1fc-cd647855fc44 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:43.396473 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4aaee063-e00c-4573-a1fc-cd647855fc44 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:43.397241 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4aaee063-e00c-4573-a1fc-cd647855fc44 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:43.397672 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4aaee063-e00c-4573-a1fc-cd647855fc44 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:43.540288 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-4aaee063-e00c-4573-a1fc-cd647855fc44 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98e41589d15488380a43000a82c2b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f102af4a74e946caa9fefc7ad0ae148c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:43.548017 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-4aaee063-e00c-4573-a1fc-cd647855fc44 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] 10.222.0.20 "GET /compute/v2.1/servers/a4f0c48f-08ac-4a62-b5f4-7138c10159cb" status: 200 len: 1504 microversion: 2.1 time: 0.163809 Jul 30 05:01:43.548585 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 248/527] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:01:43 2022] GET /compute/v2.1/servers/a4f0c48f-08ac-4a62-b5f4-7138c10159cb => generated 1504 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:01:44.049043 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-08274e9e-46e2-4040-9392-f855afe4e926 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:44.049661 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-08274e9e-46e2-4040-9392-f855afe4e926 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:44.055969 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-08274e9e-46e2-4040-9392-f855afe4e926 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:44.056371 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-08274e9e-46e2-4040-9392-f855afe4e926 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:44.057309 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-08274e9e-46e2-4040-9392-f855afe4e926 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:44.057688 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-08274e9e-46e2-4040-9392-f855afe4e926 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:44.199227 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-08274e9e-46e2-4040-9392-f855afe4e926 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:44.208319 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-08274e9e-46e2-4040-9392-f855afe4e926 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:44.209824 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-08274e9e-46e2-4040-9392-f855afe4e926 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:44.211018 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-08274e9e-46e2-4040-9392-f855afe4e926 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1808 microversion: 2.20 time: 0.166332 Jul 30 05:01:44.211571 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 280/528] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:01:44 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 05:01:44.260449 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-4b5d5e92-e810-4729-8d4b-f63929cfa033 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:44.261223 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-4b5d5e92-e810-4729-8d4b-f63929cfa033 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] [instance: 267d974a-0a42-4e11-ada0-68e101c4a48f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:44.267485 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4b5d5e92-e810-4729-8d4b-f63929cfa033 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:44.268704 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4b5d5e92-e810-4729-8d4b-f63929cfa033 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:44.269494 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4b5d5e92-e810-4729-8d4b-f63929cfa033 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:44.270009 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4b5d5e92-e810-4729-8d4b-f63929cfa033 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:44.342676 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-4b5d5e92-e810-4729-8d4b-f63929cfa033 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407ad282edd74fb1adf62fb63306779c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db365a6a9f6041a7a8749fd1a1e3d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:44.350734 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-4b5d5e92-e810-4729-8d4b-f63929cfa033 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] 10.222.0.20 "GET /compute/v2.1/servers/267d974a-0a42-4e11-ada0-68e101c4a48f" status: 200 len: 1190 microversion: 2.1 time: 0.094112 Jul 30 05:01:44.351605 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 249/529] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:01:44 2022] GET /compute/v2.1/servers/267d974a-0a42-4e11-ada0-68e101c4a48f => generated 1190 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:01:44.571965 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-b8910ead-5546-49e7-9ca6-8ba6348ff11a tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:44.572728 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-b8910ead-5546-49e7-9ca6-8ba6348ff11a tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] [instance: a4f0c48f-08ac-4a62-b5f4-7138c10159cb] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:44.581721 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b8910ead-5546-49e7-9ca6-8ba6348ff11a tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:44.582167 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b8910ead-5546-49e7-9ca6-8ba6348ff11a tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:44.582997 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b8910ead-5546-49e7-9ca6-8ba6348ff11a tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:44.583436 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b8910ead-5546-49e7-9ca6-8ba6348ff11a tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:44.723941 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-b8910ead-5546-49e7-9ca6-8ba6348ff11a tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98e41589d15488380a43000a82c2b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f102af4a74e946caa9fefc7ad0ae148c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:44.731852 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-b8910ead-5546-49e7-9ca6-8ba6348ff11a tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] 10.222.0.20 "GET /compute/v2.1/servers/a4f0c48f-08ac-4a62-b5f4-7138c10159cb" status: 200 len: 1504 microversion: 2.1 time: 0.164695 Jul 30 05:01:44.732440 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 281/530] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:01:44 2022] GET /compute/v2.1/servers/a4f0c48f-08ac-4a62-b5f4-7138c10159cb => generated 1504 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:01:45.236462 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-bc4eb4e5-f4cd-4077-ab87-593638525c20 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:45.237095 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-bc4eb4e5-f4cd-4077-ab87-593638525c20 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:45.244389 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-bc4eb4e5-f4cd-4077-ab87-593638525c20 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:45.244832 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-bc4eb4e5-f4cd-4077-ab87-593638525c20 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:45.245605 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-bc4eb4e5-f4cd-4077-ab87-593638525c20 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:45.246045 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-bc4eb4e5-f4cd-4077-ab87-593638525c20 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:45.372454 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-f7a89e95-9c21-4520-8e46-63c7d7648a5c tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:45.373149 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-f7a89e95-9c21-4520-8e46-63c7d7648a5c tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] [instance: 267d974a-0a42-4e11-ada0-68e101c4a48f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:45.380622 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f7a89e95-9c21-4520-8e46-63c7d7648a5c tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:45.380825 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f7a89e95-9c21-4520-8e46-63c7d7648a5c tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:45.381727 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f7a89e95-9c21-4520-8e46-63c7d7648a5c tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:45.382231 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f7a89e95-9c21-4520-8e46-63c7d7648a5c tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:45.384839 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-bc4eb4e5-f4cd-4077-ab87-593638525c20 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:45.394969 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-bc4eb4e5-f4cd-4077-ab87-593638525c20 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:45.396300 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-bc4eb4e5-f4cd-4077-ab87-593638525c20 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:45.397472 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-bc4eb4e5-f4cd-4077-ab87-593638525c20 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1808 microversion: 2.20 time: 0.165082 Jul 30 05:01:45.398231 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 250/531] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:01:45 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 05:01:45.449386 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-f7a89e95-9c21-4520-8e46-63c7d7648a5c tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407ad282edd74fb1adf62fb63306779c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db365a6a9f6041a7a8749fd1a1e3d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:45.457681 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-f7a89e95-9c21-4520-8e46-63c7d7648a5c tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] 10.222.0.20 "GET /compute/v2.1/servers/267d974a-0a42-4e11-ada0-68e101c4a48f" status: 200 len: 1190 microversion: 2.1 time: 0.088940 Jul 30 05:01:45.458258 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 282/532] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:01:45 2022] GET /compute/v2.1/servers/267d974a-0a42-4e11-ada0-68e101c4a48f => generated 1190 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:01:45.753462 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-63c97c55-2d45-434b-b3f8-463fbbc32bba tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:45.754718 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-63c97c55-2d45-434b-b3f8-463fbbc32bba tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] [instance: a4f0c48f-08ac-4a62-b5f4-7138c10159cb] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:45.760832 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-63c97c55-2d45-434b-b3f8-463fbbc32bba tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:45.761281 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-63c97c55-2d45-434b-b3f8-463fbbc32bba tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:45.762043 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-63c97c55-2d45-434b-b3f8-463fbbc32bba tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:45.762524 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-63c97c55-2d45-434b-b3f8-463fbbc32bba tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:45.891212 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-63c97c55-2d45-434b-b3f8-463fbbc32bba tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98e41589d15488380a43000a82c2b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f102af4a74e946caa9fefc7ad0ae148c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:45.899117 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-63c97c55-2d45-434b-b3f8-463fbbc32bba tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] 10.222.0.20 "GET /compute/v2.1/servers/a4f0c48f-08ac-4a62-b5f4-7138c10159cb" status: 200 len: 1504 microversion: 2.1 time: 0.149486 Jul 30 05:01:45.899677 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 251/533] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:01:45 2022] GET /compute/v2.1/servers/a4f0c48f-08ac-4a62-b5f4-7138c10159cb => generated 1504 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:01:46.421011 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-7015bf3a-34ea-49a6-9452-7792bb46765c tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:46.421563 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-7015bf3a-34ea-49a6-9452-7792bb46765c tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:46.428101 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7015bf3a-34ea-49a6-9452-7792bb46765c tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:46.428550 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7015bf3a-34ea-49a6-9452-7792bb46765c tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:46.429319 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7015bf3a-34ea-49a6-9452-7792bb46765c tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:46.429755 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7015bf3a-34ea-49a6-9452-7792bb46765c tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:46.478528 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-028a3a88-797a-4a96-9811-3d10020ca25f tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:46.479696 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-028a3a88-797a-4a96-9811-3d10020ca25f tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] [instance: 267d974a-0a42-4e11-ada0-68e101c4a48f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:46.489264 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-028a3a88-797a-4a96-9811-3d10020ca25f tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:46.490031 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-028a3a88-797a-4a96-9811-3d10020ca25f tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:46.491035 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-028a3a88-797a-4a96-9811-3d10020ca25f tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:46.491474 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-028a3a88-797a-4a96-9811-3d10020ca25f tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:46.566952 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-028a3a88-797a-4a96-9811-3d10020ca25f tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407ad282edd74fb1adf62fb63306779c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db365a6a9f6041a7a8749fd1a1e3d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:46.574566 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-028a3a88-797a-4a96-9811-3d10020ca25f tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] 10.222.0.20 "GET /compute/v2.1/servers/267d974a-0a42-4e11-ada0-68e101c4a48f" status: 200 len: 1190 microversion: 2.1 time: 0.099723 Jul 30 05:01:46.575127 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 252/534] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:01:46 2022] GET /compute/v2.1/servers/267d974a-0a42-4e11-ada0-68e101c4a48f => generated 1190 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:01:46.682746 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-7015bf3a-34ea-49a6-9452-7792bb46765c tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:46.691351 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-7015bf3a-34ea-49a6-9452-7792bb46765c tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:46.693246 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-7015bf3a-34ea-49a6-9452-7792bb46765c tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:46.694416 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-7015bf3a-34ea-49a6-9452-7792bb46765c tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1808 microversion: 2.20 time: 0.277667 Jul 30 05:01:46.695026 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 283/535] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:01:46 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1808 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 05:01:46.920632 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-1ac826f8-345c-4cd0-8535-b1b74e512679 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:46.921236 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-1ac826f8-345c-4cd0-8535-b1b74e512679 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] [instance: a4f0c48f-08ac-4a62-b5f4-7138c10159cb] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:46.928291 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1ac826f8-345c-4cd0-8535-b1b74e512679 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:46.928735 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1ac826f8-345c-4cd0-8535-b1b74e512679 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:46.929494 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1ac826f8-345c-4cd0-8535-b1b74e512679 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:46.929927 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1ac826f8-345c-4cd0-8535-b1b74e512679 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:46.995932 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-1ac826f8-345c-4cd0-8535-b1b74e512679 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98e41589d15488380a43000a82c2b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f102af4a74e946caa9fefc7ad0ae148c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:47.003440 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-1ac826f8-345c-4cd0-8535-b1b74e512679 tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] 10.222.0.20 "GET /compute/v2.1/servers/a4f0c48f-08ac-4a62-b5f4-7138c10159cb" status: 200 len: 1462 microversion: 2.1 time: 0.086970 Jul 30 05:01:47.004439 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 253/536] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:01:46 2022] GET /compute/v2.1/servers/a4f0c48f-08ac-4a62-b5f4-7138c10159cb => generated 1462 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:01:47.026415 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-fbbbc95d-5d56-4fde-994e-eaf7050e7e67 req-1ae23a1b-678c-4a4e-8f2e-47823cf977ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4f0c48f-08ac-4a62-b5f4-7138c10159cb", "name": "network-vif-deleted", "tag": "b6093eab-acff-4f9e-9803-4facdba24732"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:01:47.036530 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-fbbbc95d-5d56-4fde-994e-eaf7050e7e67 req-1ae23a1b-678c-4a4e-8f2e-47823cf977ef service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:47.036973 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-fbbbc95d-5d56-4fde-994e-eaf7050e7e67 req-1ae23a1b-678c-4a4e-8f2e-47823cf977ef service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:47.048767 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-fbbbc95d-5d56-4fde-994e-eaf7050e7e67 req-1ae23a1b-678c-4a4e-8f2e-47823cf977ef service nova] Creating event network-vif-deleted:b6093eab-acff-4f9e-9803-4facdba24732 for instance a4f0c48f-08ac-4a62-b5f4-7138c10159cb on hv-cinder-85127 Jul 30 05:01:47.054760 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-fbbbc95d-5d56-4fde-994e-eaf7050e7e67 req-1ae23a1b-678c-4a4e-8f2e-47823cf977ef service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031932 Jul 30 05:01:47.055542 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 284/537] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Jul 30 05:01:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 05:01:47.591106 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-638c1b33-1e10-4041-8a7f-65e6291d2dcc tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:47.591751 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-638c1b33-1e10-4041-8a7f-65e6291d2dcc tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] [instance: fdf672c0-82ac-413b-a8cc-e01a4de45c4e] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:47.597153 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-b114026e-5469-480b-b8e6-22d21bc6675c tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:47.598017 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-b114026e-5469-480b-b8e6-22d21bc6675c tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] [instance: 267d974a-0a42-4e11-ada0-68e101c4a48f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:47.598955 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-638c1b33-1e10-4041-8a7f-65e6291d2dcc tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:47.599413 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-638c1b33-1e10-4041-8a7f-65e6291d2dcc tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:47.600191 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-638c1b33-1e10-4041-8a7f-65e6291d2dcc tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:47.600654 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-638c1b33-1e10-4041-8a7f-65e6291d2dcc tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:47.604874 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b114026e-5469-480b-b8e6-22d21bc6675c tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:47.605328 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b114026e-5469-480b-b8e6-22d21bc6675c tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:47.606218 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b114026e-5469-480b-b8e6-22d21bc6675c tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:47.606768 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b114026e-5469-480b-b8e6-22d21bc6675c tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:47.641530 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-638c1b33-1e10-4041-8a7f-65e6291d2dcc tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] [instance: fdf672c0-82ac-413b-a8cc-e01a4de45c4e] Going to try to terminate instance {{(pid=117885) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 05:01:47.734582 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-b114026e-5469-480b-b8e6-22d21bc6675c tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407ad282edd74fb1adf62fb63306779c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db365a6a9f6041a7a8749fd1a1e3d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:47.745996 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-b114026e-5469-480b-b8e6-22d21bc6675c tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] 10.222.0.20 "GET /compute/v2.1/servers/267d974a-0a42-4e11-ada0-68e101c4a48f" status: 200 len: 1208 microversion: 2.1 time: 0.153187 Jul 30 05:01:47.751003 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 285/538] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:01:47 2022] GET /compute/v2.1/servers/267d974a-0a42-4e11-ada0-68e101c4a48f => generated 1208 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 05:01:47.758108 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-ccf822e7-93c4-40df-8133-e9d647de0702 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:47.761897 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-638c1b33-1e10-4041-8a7f-65e6291d2dcc tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] 10.222.0.20 "DELETE /compute/v2.1/servers/fdf672c0-82ac-413b-a8cc-e01a4de45c4e" status: 204 len: 0 microversion: 2.1 time: 0.174459 Jul 30 05:01:47.762793 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 254/539] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Jul 30 05:01:47 2022] DELETE /compute/v2.1/servers/fdf672c0-82ac-413b-a8cc-e01a4de45c4e => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 05:01:47.763239 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-ccf822e7-93c4-40df-8133-e9d647de0702 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:47.771721 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-7bcbb5ec-c986-416c-a119-d9cd4901bf2a tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:47.772433 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-7bcbb5ec-c986-416c-a119-d9cd4901bf2a tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] [instance: fdf672c0-82ac-413b-a8cc-e01a4de45c4e] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:47.778696 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7bcbb5ec-c986-416c-a119-d9cd4901bf2a tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:47.779375 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7bcbb5ec-c986-416c-a119-d9cd4901bf2a tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:47.779521 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ccf822e7-93c4-40df-8133-e9d647de0702 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:47.780198 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ccf822e7-93c4-40df-8133-e9d647de0702 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:47.780636 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7bcbb5ec-c986-416c-a119-d9cd4901bf2a tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:47.781198 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ccf822e7-93c4-40df-8133-e9d647de0702 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:47.781515 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7bcbb5ec-c986-416c-a119-d9cd4901bf2a tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:47.782292 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ccf822e7-93c4-40df-8133-e9d647de0702 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:47.922766 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-7bcbb5ec-c986-416c-a119-d9cd4901bf2a tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334f2d8d9d9a4f7a90586999398f8a40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a02f6df4ed4365b3ce1fa970f9cf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:47.926989 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:01:47.932212 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-7bcbb5ec-c986-416c-a119-d9cd4901bf2a tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] 10.222.0.20 "GET /compute/v2.1/servers/fdf672c0-82ac-413b-a8cc-e01a4de45c4e" status: 200 len: 1512 microversion: 2.1 time: 0.164845 Jul 30 05:01:47.932788 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 255/540] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:01:47 2022] GET /compute/v2.1/servers/fdf672c0-82ac-413b-a8cc-e01a4de45c4e => generated 1512 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:01:48.025685 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-e9c31472-70c3-486c-b272-3a18cbeba24a tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:48.026638 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-e9c31472-70c3-486c-b272-3a18cbeba24a tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] [instance: a4f0c48f-08ac-4a62-b5f4-7138c10159cb] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:48.030182 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-ccf822e7-93c4-40df-8133-e9d647de0702 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:48.039581 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-ccf822e7-93c4-40df-8133-e9d647de0702 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:48.041163 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e9c31472-70c3-486c-b272-3a18cbeba24a tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:48.041350 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-ccf822e7-93c4-40df-8133-e9d647de0702 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:48.041619 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e9c31472-70c3-486c-b272-3a18cbeba24a tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:48.042389 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e9c31472-70c3-486c-b272-3a18cbeba24a tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:48.042845 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e9c31472-70c3-486c-b272-3a18cbeba24a tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:48.043079 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-ccf822e7-93c4-40df-8133-e9d647de0702 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1808 microversion: 2.20 time: 0.290737 Jul 30 05:01:48.043629 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 286/541] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:01:47 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1808 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 05:01:48.061316 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.wsgi [None req-e9c31472-70c3-486c-b272-3a18cbeba24a tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] HTTP exception thrown: Instance a4f0c48f-08ac-4a62-b5f4-7138c10159cb could not be found. Jul 30 05:01:48.063237 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-e9c31472-70c3-486c-b272-3a18cbeba24a tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Request method failure captured: Jul 30 05:01:48.063237 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: request: GET /compute/v2.1/servers/a4f0c48f-08ac-4a62-b5f4-7138c10159cb HTTP/1.1 Jul 30 05:01:48.063237 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Accept: application/json Jul 30 05:01:48.063237 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Accept-Encoding: identity Jul 30 05:01:48.063237 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Connection: close Jul 30 05:01:48.063237 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Content-Length: 0 Jul 30 05:01:48.063237 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Content-Type: application/json Jul 30 05:01:48.063237 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Host: 10.222.0.20 Jul 30 05:01:48.063237 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Openstack-System-Scope: None Jul 30 05:01:48.063237 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: User-Agent: python-urllib3/1.26.10 Jul 30 05:01:48.063237 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Auth-Token: gAAAAABi5LrxRwAmJ55a8z3q5U635j188V2Cr8mYNRG2XxF-v4rvZne2FAoHdoKdRXioFShbGdL1axBP-3iQBHwNDwEHXmNShh224Z3B-zkkky6S1aG4PZOYn5UT8fkJ09iYZ-7jPLaR3flInr5auV1a-O49hTrSgEuEeMbczpnY7zm1U4ywCv8 Jul 30 05:01:48.063237 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Domain-Id: None Jul 30 05:01:48.063237 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Domain-Name: None Jul 30 05:01:48.063237 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Identity-Status: Confirmed Jul 30 05:01:48.063237 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Is-Admin-Project: True Jul 30 05:01:48.063237 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Domain-Id: default Jul 30 05:01:48.063237 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Domain-Name: Default Jul 30 05:01:48.063237 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Id: f102af4a74e946caa9fefc7ad0ae148c Jul 30 05:01:48.063237 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Name: tempest-VolumesActionsTest-350598693 Jul 30 05:01:48.063237 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Role: member,reader Jul 30 05:01:48.063237 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Roles: member,reader Jul 30 05:01:48.064626 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f102af4a74e946caa9fefc7ad0ae148c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f102af4a74e946caa9fefc7ad0ae148c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f102af4a74e946caa9fefc7ad0ae148c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f102af4a74e946caa9fefc7ad0ae148c"}]}] Jul 30 05:01:48.064626 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Tenant: tempest-VolumesActionsTest-350598693 Jul 30 05:01:48.064626 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Tenant-Id: f102af4a74e946caa9fefc7ad0ae148c Jul 30 05:01:48.064626 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Tenant-Name: tempest-VolumesActionsTest-350598693 Jul 30 05:01:48.064626 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User: tempest-VolumesActionsTest-350598693-project Jul 30 05:01:48.064626 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Domain-Id: default Jul 30 05:01:48.064626 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Domain-Name: Default Jul 30 05:01:48.064626 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Id: b98e41589d15488380a43000a82c2b3c Jul 30 05:01:48.064626 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Name: tempest-VolumesActionsTest-350598693-project Jul 30 05:01:48.064626 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: method: > Jul 30 05:01:48.064626 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: exception: Instance a4f0c48f-08ac-4a62-b5f4-7138c10159cb could not be found. Jul 30 05:01:48.064626 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: action_args: {'id': 'a4f0c48f-08ac-4a62-b5f4-7138c10159cb'} Jul 30 05:01:48.065476 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 05:01:48.065476 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:01:48.065476 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 05:01:48.065476 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 05:01:48.065476 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 05:01:48.065476 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 05:01:48.065476 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 05:01:48.065476 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 05:01:48.065476 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 05:01:48.065476 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 05:01:48.065476 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4f0c48f-08ac-4a62-b5f4-7138c10159cb could not be found. Jul 30 05:01:48.065476 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:01:48.065476 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 05:01:48.065476 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:01:48.065476 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:01:48.065476 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 05:01:48.065476 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 05:01:48.065476 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 05:01:48.065476 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 05:01:48.065476 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 05:01:48.067955 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 05:01:48.067955 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 05:01:48.067955 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 05:01:48.067955 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 05:01:48.067955 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 05:01:48.067955 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 05:01:48.067955 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 05:01:48.067955 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4f0c48f-08ac-4a62-b5f4-7138c10159cb could not be found. Jul 30 05:01:48.067955 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:01:48.067955 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 05:01:48.067955 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:01:48.067955 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:01:48.067955 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 05:01:48.067955 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 05:01:48.067955 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 05:01:48.067955 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 05:01:48.067955 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4f0c48f-08ac-4a62-b5f4-7138c10159cb could not be found. Jul 30 05:01:48.067955 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:01:48.069281 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-e9c31472-70c3-486c-b272-3a18cbeba24a tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] Returning 404 to user: Instance a4f0c48f-08ac-4a62-b5f4-7138c10159cb could not be found. {{(pid=117885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 05:01:48.069281 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-e9c31472-70c3-486c-b272-3a18cbeba24a tempest-VolumesActionsTest-350598693 tempest-VolumesActionsTest-350598693-project] 10.222.0.20 "GET /compute/v2.1/servers/a4f0c48f-08ac-4a62-b5f4-7138c10159cb" status: 404 len: 111 microversion: 2.1 time: 0.044711 Jul 30 05:01:48.069281 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 256/542] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:01:48 2022] GET /compute/v2.1/servers/a4f0c48f-08ac-4a62-b5f4-7138c10159cb => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 30 05:01:48.769626 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-f2e9edaf-a0a0-4e75-b022-3941b938c4c1 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:48.770328 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-f2e9edaf-a0a0-4e75-b022-3941b938c4c1 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] [instance: 267d974a-0a42-4e11-ada0-68e101c4a48f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:48.776847 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f2e9edaf-a0a0-4e75-b022-3941b938c4c1 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:48.777331 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f2e9edaf-a0a0-4e75-b022-3941b938c4c1 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:48.778096 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f2e9edaf-a0a0-4e75-b022-3941b938c4c1 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:48.778561 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f2e9edaf-a0a0-4e75-b022-3941b938c4c1 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:48.919329 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-f2e9edaf-a0a0-4e75-b022-3941b938c4c1 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407ad282edd74fb1adf62fb63306779c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db365a6a9f6041a7a8749fd1a1e3d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:48.927047 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-f2e9edaf-a0a0-4e75-b022-3941b938c4c1 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] 10.222.0.20 "GET /compute/v2.1/servers/267d974a-0a42-4e11-ada0-68e101c4a48f" status: 200 len: 1273 microversion: 2.1 time: 0.161976 Jul 30 05:01:48.927631 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 287/543] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:01:48 2022] GET /compute/v2.1/servers/267d974a-0a42-4e11-ada0-68e101c4a48f => generated 1273 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:01:48.953650 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-fbedc671-1a9d-437e-a495-f32e1311350c tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:48.954264 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-fbedc671-1a9d-437e-a495-f32e1311350c tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] [instance: fdf672c0-82ac-413b-a8cc-e01a4de45c4e] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:48.961405 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-fbedc671-1a9d-437e-a495-f32e1311350c tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:48.961849 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-fbedc671-1a9d-437e-a495-f32e1311350c tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:48.962638 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-fbedc671-1a9d-437e-a495-f32e1311350c tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:48.963071 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-fbedc671-1a9d-437e-a495-f32e1311350c tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:49.068319 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-a545a7e5-ad25-47a9-905b-7b990c37cd43 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:49.068845 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-a545a7e5-ad25-47a9-905b-7b990c37cd43 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:49.074734 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a545a7e5-ad25-47a9-905b-7b990c37cd43 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:49.075182 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a545a7e5-ad25-47a9-905b-7b990c37cd43 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:49.076029 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a545a7e5-ad25-47a9-905b-7b990c37cd43 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:49.076478 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a545a7e5-ad25-47a9-905b-7b990c37cd43 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:49.092958 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-fbedc671-1a9d-437e-a495-f32e1311350c tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334f2d8d9d9a4f7a90586999398f8a40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a02f6df4ed4365b3ce1fa970f9cf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:49.100478 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-fbedc671-1a9d-437e-a495-f32e1311350c tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] 10.222.0.20 "GET /compute/v2.1/servers/fdf672c0-82ac-413b-a8cc-e01a4de45c4e" status: 200 len: 1512 microversion: 2.1 time: 0.150551 Jul 30 05:01:49.101077 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 257/544] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:01:48 2022] GET /compute/v2.1/servers/fdf672c0-82ac-413b-a8cc-e01a4de45c4e => generated 1512 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:01:49.208719 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-a545a7e5-ad25-47a9-905b-7b990c37cd43 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:49.216993 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-a545a7e5-ad25-47a9-905b-7b990c37cd43 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:49.218508 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-a545a7e5-ad25-47a9-905b-7b990c37cd43 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:49.219652 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-a545a7e5-ad25-47a9-905b-7b990c37cd43 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1808 microversion: 2.20 time: 0.155968 Jul 30 05:01:49.220330 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 288/545] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:01:49 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 05:01:49.947817 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-4b64a315-96d9-4570-9b8e-4a8d06758460 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:49.948428 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-4b64a315-96d9-4570-9b8e-4a8d06758460 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] [instance: 267d974a-0a42-4e11-ada0-68e101c4a48f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:49.954463 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4b64a315-96d9-4570-9b8e-4a8d06758460 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:49.955031 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4b64a315-96d9-4570-9b8e-4a8d06758460 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:49.955716 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4b64a315-96d9-4570-9b8e-4a8d06758460 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:49.956138 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4b64a315-96d9-4570-9b8e-4a8d06758460 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:50.088868 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-4b64a315-96d9-4570-9b8e-4a8d06758460 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407ad282edd74fb1adf62fb63306779c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db365a6a9f6041a7a8749fd1a1e3d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:50.096161 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-4b64a315-96d9-4570-9b8e-4a8d06758460 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] 10.222.0.20 "GET /compute/v2.1/servers/267d974a-0a42-4e11-ada0-68e101c4a48f" status: 200 len: 1273 microversion: 2.1 time: 0.152374 Jul 30 05:01:50.096714 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 258/546] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:01:49 2022] GET /compute/v2.1/servers/267d974a-0a42-4e11-ada0-68e101c4a48f => generated 1273 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:01:50.120938 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-76ed327f-d765-4488-addc-2b082a22d9d0 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:50.121482 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-76ed327f-d765-4488-addc-2b082a22d9d0 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] [instance: fdf672c0-82ac-413b-a8cc-e01a4de45c4e] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:50.127991 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-76ed327f-d765-4488-addc-2b082a22d9d0 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:50.128439 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-76ed327f-d765-4488-addc-2b082a22d9d0 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:50.129876 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-76ed327f-d765-4488-addc-2b082a22d9d0 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:50.130305 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-76ed327f-d765-4488-addc-2b082a22d9d0 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:50.244065 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-e22d69d6-5725-4ef3-b721-0cab1ecfb85c tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:50.244708 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-e22d69d6-5725-4ef3-b721-0cab1ecfb85c tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:50.250685 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e22d69d6-5725-4ef3-b721-0cab1ecfb85c tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:50.251140 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e22d69d6-5725-4ef3-b721-0cab1ecfb85c tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:50.251906 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e22d69d6-5725-4ef3-b721-0cab1ecfb85c tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:50.252345 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e22d69d6-5725-4ef3-b721-0cab1ecfb85c tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:50.260809 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-76ed327f-d765-4488-addc-2b082a22d9d0 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334f2d8d9d9a4f7a90586999398f8a40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a02f6df4ed4365b3ce1fa970f9cf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:50.268152 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-76ed327f-d765-4488-addc-2b082a22d9d0 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] 10.222.0.20 "GET /compute/v2.1/servers/fdf672c0-82ac-413b-a8cc-e01a4de45c4e" status: 200 len: 1512 microversion: 2.1 time: 0.151021 Jul 30 05:01:50.268716 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 289/547] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:01:50 2022] GET /compute/v2.1/servers/fdf672c0-82ac-413b-a8cc-e01a4de45c4e => generated 1512 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:01:50.383485 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-e22d69d6-5725-4ef3-b721-0cab1ecfb85c tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:50.391692 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-e22d69d6-5725-4ef3-b721-0cab1ecfb85c tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:50.393185 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-e22d69d6-5725-4ef3-b721-0cab1ecfb85c tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:50.394478 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-e22d69d6-5725-4ef3-b721-0cab1ecfb85c tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1808 microversion: 2.20 time: 0.154198 Jul 30 05:01:50.395034 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 259/548] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:01:50 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 05:01:51.117892 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-db83b5ed-f730-4cb4-b3db-f10b2bbfcdf4 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:51.118573 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-db83b5ed-f730-4cb4-b3db-f10b2bbfcdf4 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] [instance: 267d974a-0a42-4e11-ada0-68e101c4a48f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:51.125219 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-db83b5ed-f730-4cb4-b3db-f10b2bbfcdf4 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:51.125770 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-db83b5ed-f730-4cb4-b3db-f10b2bbfcdf4 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:51.126425 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-db83b5ed-f730-4cb4-b3db-f10b2bbfcdf4 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:51.126890 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-db83b5ed-f730-4cb4-b3db-f10b2bbfcdf4 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:51.255596 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-db83b5ed-f730-4cb4-b3db-f10b2bbfcdf4 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407ad282edd74fb1adf62fb63306779c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db365a6a9f6041a7a8749fd1a1e3d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:51.262942 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-db83b5ed-f730-4cb4-b3db-f10b2bbfcdf4 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] 10.222.0.20 "GET /compute/v2.1/servers/267d974a-0a42-4e11-ada0-68e101c4a48f" status: 200 len: 1273 microversion: 2.1 time: 0.149907 Jul 30 05:01:51.263502 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 290/549] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:01:51 2022] GET /compute/v2.1/servers/267d974a-0a42-4e11-ada0-68e101c4a48f => generated 1273 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:01:51.289474 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-a177867a-e517-4e05-a3af-03c3f61188d6 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:51.290092 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-a177867a-e517-4e05-a3af-03c3f61188d6 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] [instance: fdf672c0-82ac-413b-a8cc-e01a4de45c4e] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:51.296872 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a177867a-e517-4e05-a3af-03c3f61188d6 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:51.297321 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a177867a-e517-4e05-a3af-03c3f61188d6 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:51.298085 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a177867a-e517-4e05-a3af-03c3f61188d6 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:51.298561 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a177867a-e517-4e05-a3af-03c3f61188d6 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:51.417910 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-89661333-7e9f-4b30-8ccb-6c36d1c389e0 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:51.418549 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-89661333-7e9f-4b30-8ccb-6c36d1c389e0 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:51.424756 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-89661333-7e9f-4b30-8ccb-6c36d1c389e0 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:51.425235 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-89661333-7e9f-4b30-8ccb-6c36d1c389e0 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:51.426360 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-89661333-7e9f-4b30-8ccb-6c36d1c389e0 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:51.426836 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-89661333-7e9f-4b30-8ccb-6c36d1c389e0 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:51.428437 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-a177867a-e517-4e05-a3af-03c3f61188d6 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334f2d8d9d9a4f7a90586999398f8a40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a02f6df4ed4365b3ce1fa970f9cf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:51.431061 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=100 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:01:51.436391 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-a177867a-e517-4e05-a3af-03c3f61188d6 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] 10.222.0.20 "GET /compute/v2.1/servers/fdf672c0-82ac-413b-a8cc-e01a4de45c4e" status: 200 len: 1512 microversion: 2.1 time: 0.150873 Jul 30 05:01:51.436959 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 260/550] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:01:51 2022] GET /compute/v2.1/servers/fdf672c0-82ac-413b-a8cc-e01a4de45c4e => generated 1512 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:01:51.562962 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-89661333-7e9f-4b30-8ccb-6c36d1c389e0 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:51.572248 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-89661333-7e9f-4b30-8ccb-6c36d1c389e0 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:51.573758 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-89661333-7e9f-4b30-8ccb-6c36d1c389e0 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:51.574944 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-89661333-7e9f-4b30-8ccb-6c36d1c389e0 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1808 microversion: 2.20 time: 0.160990 Jul 30 05:01:51.575504 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 291/551] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:01:51 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 05:01:52.284153 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-5bb31403-4944-4795-bdb3-d3b8cc054d2f tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:52.285252 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-5bb31403-4944-4795-bdb3-d3b8cc054d2f tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] [instance: 267d974a-0a42-4e11-ada0-68e101c4a48f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:52.291434 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5bb31403-4944-4795-bdb3-d3b8cc054d2f tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:52.292017 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5bb31403-4944-4795-bdb3-d3b8cc054d2f tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:52.293292 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5bb31403-4944-4795-bdb3-d3b8cc054d2f tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:52.294042 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5bb31403-4944-4795-bdb3-d3b8cc054d2f tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:52.327495 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-46faa531-bdbe-4103-8143-0c9d97ada28e req-cc56d222-4a0c-402f-a645-76e5997335ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "267d974a-0a42-4e11-ada0-68e101c4a48f", "tag": "aa5879dd-2e84-4f75-818a-bc12a63594f3"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:01:52.339181 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-46faa531-bdbe-4103-8143-0c9d97ada28e req-cc56d222-4a0c-402f-a645-76e5997335ab service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:52.340044 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-46faa531-bdbe-4103-8143-0c9d97ada28e req-cc56d222-4a0c-402f-a645-76e5997335ab service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:52.354082 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-46faa531-bdbe-4103-8143-0c9d97ada28e req-cc56d222-4a0c-402f-a645-76e5997335ab service nova] Creating event network-changed:aa5879dd-2e84-4f75-818a-bc12a63594f3 for instance 267d974a-0a42-4e11-ada0-68e101c4a48f on hv-cinder-85127 Jul 30 05:01:52.359123 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-46faa531-bdbe-4103-8143-0c9d97ada28e req-cc56d222-4a0c-402f-a645-76e5997335ab service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035214 Jul 30 05:01:52.359728 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 292/552] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Jul 30 05:01:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 05:01:52.439272 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-5bb31403-4944-4795-bdb3-d3b8cc054d2f tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407ad282edd74fb1adf62fb63306779c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db365a6a9f6041a7a8749fd1a1e3d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:52.446706 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-5bb31403-4944-4795-bdb3-d3b8cc054d2f tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] 10.222.0.20 "GET /compute/v2.1/servers/267d974a-0a42-4e11-ada0-68e101c4a48f" status: 200 len: 1261 microversion: 2.1 time: 0.166528 Jul 30 05:01:52.447269 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 261/553] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:01:52 2022] GET /compute/v2.1/servers/267d974a-0a42-4e11-ada0-68e101c4a48f => generated 1261 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:01:52.462142 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-dd0eefbe-313c-4a42-8036-52bed5a51c7b tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:52.462870 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-dd0eefbe-313c-4a42-8036-52bed5a51c7b tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] [instance: fdf672c0-82ac-413b-a8cc-e01a4de45c4e] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:52.469113 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-dd0eefbe-313c-4a42-8036-52bed5a51c7b tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:52.469568 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-dd0eefbe-313c-4a42-8036-52bed5a51c7b tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:52.470332 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-dd0eefbe-313c-4a42-8036-52bed5a51c7b tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:52.470808 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-dd0eefbe-313c-4a42-8036-52bed5a51c7b tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:52.599214 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-2923f84a-841c-4ba3-8bc9-4d0ace4b060a tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:52.599827 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-2923f84a-841c-4ba3-8bc9-4d0ace4b060a tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:52.605807 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2923f84a-841c-4ba3-8bc9-4d0ace4b060a tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:52.606252 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2923f84a-841c-4ba3-8bc9-4d0ace4b060a tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:52.607046 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2923f84a-841c-4ba3-8bc9-4d0ace4b060a tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:52.607477 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2923f84a-841c-4ba3-8bc9-4d0ace4b060a tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:52.629162 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-dd0eefbe-313c-4a42-8036-52bed5a51c7b tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334f2d8d9d9a4f7a90586999398f8a40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a02f6df4ed4365b3ce1fa970f9cf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:52.636684 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-dd0eefbe-313c-4a42-8036-52bed5a51c7b tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] 10.222.0.20 "GET /compute/v2.1/servers/fdf672c0-82ac-413b-a8cc-e01a4de45c4e" status: 200 len: 1512 microversion: 2.1 time: 0.178710 Jul 30 05:01:52.642878 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 293/554] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:01:52 2022] GET /compute/v2.1/servers/fdf672c0-82ac-413b-a8cc-e01a4de45c4e => generated 1512 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:01:52.735406 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-2923f84a-841c-4ba3-8bc9-4d0ace4b060a tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:52.744337 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-2923f84a-841c-4ba3-8bc9-4d0ace4b060a tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:52.745830 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-2923f84a-841c-4ba3-8bc9-4d0ace4b060a tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:52.747014 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-2923f84a-841c-4ba3-8bc9-4d0ace4b060a tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1808 microversion: 2.20 time: 0.152448 Jul 30 05:01:52.747572 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 262/555] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:01:52 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 05:01:53.468629 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-4c67557d-6cc8-4f76-8289-6e9d36b15f6f tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:53.469990 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-4c67557d-6cc8-4f76-8289-6e9d36b15f6f tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] [instance: 267d974a-0a42-4e11-ada0-68e101c4a48f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:53.476661 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:01:53.478387 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4c67557d-6cc8-4f76-8289-6e9d36b15f6f tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:53.479033 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4c67557d-6cc8-4f76-8289-6e9d36b15f6f tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:53.480178 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4c67557d-6cc8-4f76-8289-6e9d36b15f6f tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:53.480772 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4c67557d-6cc8-4f76-8289-6e9d36b15f6f tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:53.658747 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-1df4e698-277c-4c25-98ea-bce6e104f38d tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:53.659354 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-1df4e698-277c-4c25-98ea-bce6e104f38d tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] [instance: fdf672c0-82ac-413b-a8cc-e01a4de45c4e] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:53.672498 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1df4e698-277c-4c25-98ea-bce6e104f38d tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:53.673244 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1df4e698-277c-4c25-98ea-bce6e104f38d tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:53.674207 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1df4e698-277c-4c25-98ea-bce6e104f38d tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:53.674907 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1df4e698-277c-4c25-98ea-bce6e104f38d tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:53.712942 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-4c67557d-6cc8-4f76-8289-6e9d36b15f6f tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407ad282edd74fb1adf62fb63306779c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db365a6a9f6041a7a8749fd1a1e3d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:53.722029 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-4c67557d-6cc8-4f76-8289-6e9d36b15f6f tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] 10.222.0.20 "GET /compute/v2.1/servers/267d974a-0a42-4e11-ada0-68e101c4a48f" status: 200 len: 1261 microversion: 2.1 time: 0.257166 Jul 30 05:01:53.723226 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 294/556] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:01:53 2022] GET /compute/v2.1/servers/267d974a-0a42-4e11-ada0-68e101c4a48f => generated 1261 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:01:53.772060 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-b069041f-7843-49e6-b7b4-572d1d90dbb1 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:53.773043 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-b069041f-7843-49e6-b7b4-572d1d90dbb1 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:53.781085 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b069041f-7843-49e6-b7b4-572d1d90dbb1 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:53.781814 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b069041f-7843-49e6-b7b4-572d1d90dbb1 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:53.782840 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b069041f-7843-49e6-b7b4-572d1d90dbb1 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:53.787013 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b069041f-7843-49e6-b7b4-572d1d90dbb1 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:54.006789 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-1df4e698-277c-4c25-98ea-bce6e104f38d tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334f2d8d9d9a4f7a90586999398f8a40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a02f6df4ed4365b3ce1fa970f9cf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:54.022900 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-1df4e698-277c-4c25-98ea-bce6e104f38d tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] 10.222.0.20 "GET /compute/v2.1/servers/fdf672c0-82ac-413b-a8cc-e01a4de45c4e" status: 200 len: 1512 microversion: 2.1 time: 0.367334 Jul 30 05:01:54.024406 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 263/557] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:01:53 2022] GET /compute/v2.1/servers/fdf672c0-82ac-413b-a8cc-e01a4de45c4e => generated 1512 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:01:54.048462 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-eca9e125-c38e-4f6c-9539-28f594c117f4 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:54.049404 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-eca9e125-c38e-4f6c-9539-28f594c117f4 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: 22fe5ad8-01f8-4d0a-bb24-7c23a427d328] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:54.054066 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-b069041f-7843-49e6-b7b4-572d1d90dbb1 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:54.058647 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-eca9e125-c38e-4f6c-9539-28f594c117f4 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:54.059377 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-eca9e125-c38e-4f6c-9539-28f594c117f4 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:54.060370 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-eca9e125-c38e-4f6c-9539-28f594c117f4 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:54.061315 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-eca9e125-c38e-4f6c-9539-28f594c117f4 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:54.064023 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-b069041f-7843-49e6-b7b4-572d1d90dbb1 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:54.071016 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-b069041f-7843-49e6-b7b4-572d1d90dbb1 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:54.072217 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-b069041f-7843-49e6-b7b4-572d1d90dbb1 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1808 microversion: 2.20 time: 0.305456 Jul 30 05:01:54.080066 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 295/558] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:01:53 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1808 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 05:01:54.105248 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-eca9e125-c38e-4f6c-9539-28f594c117f4 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/22fe5ad8-01f8-4d0a-bb24-7c23a427d328/ips" status: 200 len: 150 microversion: 2.1 time: 0.062932 Jul 30 05:01:54.106168 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 264/559] 10.222.0.20 () {58 vars in 1248 bytes} [Sat Jul 30 05:01:54 2022] GET /compute/v2.1/servers/22fe5ad8-01f8-4d0a-bb24-7c23a427d328/ips => generated 150 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 05:01:54.118750 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-c8b93a5b-a99b-46c6-82e9-a6f0f920c26e tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "41a25d81-2695-4312-b74a-a5f51bacc1ea"}} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:01:54.122006 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-c8b93a5b-a99b-46c6-82e9-a6f0f920c26e tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: 22fe5ad8-01f8-4d0a-bb24-7c23a427d328] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:54.130506 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c8b93a5b-a99b-46c6-82e9-a6f0f920c26e tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:54.131999 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c8b93a5b-a99b-46c6-82e9-a6f0f920c26e tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:54.132959 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c8b93a5b-a99b-46c6-82e9-a6f0f920c26e tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:54.133891 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c8b93a5b-a99b-46c6-82e9-a6f0f920c26e tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:54.239340 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.wsgi [None req-c8b93a5b-a99b-46c6-82e9-a6f0f920c26e tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] HTTP exception thrown: Invalid volume: volume 41a25d81-2695-4312-b74a-a5f51bacc1ea is already attached to instances: f27c16ec-7d74-4a2a-9b40-c95455fa8aff Jul 30 05:01:54.243812 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-c8b93a5b-a99b-46c6-82e9-a6f0f920c26e tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Request method failure captured: Jul 30 05:01:54.243812 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: request: POST /compute/v2.1/servers/22fe5ad8-01f8-4d0a-bb24-7c23a427d328/os-volume_attachments HTTP/1.1 Jul 30 05:01:54.243812 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Accept: application/json Jul 30 05:01:54.243812 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Accept-Encoding: identity Jul 30 05:01:54.243812 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Connection: close Jul 30 05:01:54.243812 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Content-Length: 74 Jul 30 05:01:54.243812 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Content-Type: application/json Jul 30 05:01:54.243812 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Host: 10.222.0.20 Jul 30 05:01:54.243812 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Openstack-System-Scope: None Jul 30 05:01:54.243812 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: User-Agent: python-urllib3/1.26.10 Jul 30 05:01:54.243812 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Auth-Token: gAAAAABi5LpsOyvntIvMWRkdgHAWaqLWWQheVZGRSyU7m8d_2qr8zQQH3DOakkgVq23Q75nTB9odGI0F-DQpTcNmJESi7-iRiz2-Pz62AvInyIstK7nwhx7nj-QdimoRc10ZS0jEzNztVniYwiMWef1RbG0o7cJ-tzIv7p3eOvqZTnGZgHQkQhc Jul 30 05:01:54.243812 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Domain-Id: None Jul 30 05:01:54.243812 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Domain-Name: None Jul 30 05:01:54.243812 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Identity-Status: Confirmed Jul 30 05:01:54.243812 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Is-Admin-Project: True Jul 30 05:01:54.243812 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Project-Domain-Id: default Jul 30 05:01:54.243812 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Project-Domain-Name: Default Jul 30 05:01:54.243812 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Project-Id: e01500cb03c74d1082090cd1c1836169 Jul 30 05:01:54.243812 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Project-Name: tempest-AttachVolumeNegativeTest-490621097 Jul 30 05:01:54.243812 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Role: member,reader Jul 30 05:01:54.243812 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Roles: member,reader Jul 30 05:01:54.245993 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e01500cb03c74d1082090cd1c1836169"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e01500cb03c74d1082090cd1c1836169"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e01500cb03c74d1082090cd1c1836169"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e01500cb03c74d1082090cd1c1836169"}]}] Jul 30 05:01:54.245993 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Tenant: tempest-AttachVolumeNegativeTest-490621097 Jul 30 05:01:54.245993 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Tenant-Id: e01500cb03c74d1082090cd1c1836169 Jul 30 05:01:54.245993 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-490621097 Jul 30 05:01:54.245993 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User: tempest-AttachVolumeNegativeTest-490621097-project Jul 30 05:01:54.245993 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User-Domain-Id: default Jul 30 05:01:54.245993 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User-Domain-Name: Default Jul 30 05:01:54.245993 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User-Id: a8abb58f9c274e568d2d0fe3d4df11de Jul 30 05:01:54.245993 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User-Name: tempest-AttachVolumeNegativeTest-490621097-project Jul 30 05:01:54.245993 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Jul 30 05:01:54.245993 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: {"volumeAttachment": {"volumeId": "41a25d81-2695-4312-b74a-a5f51bacc1ea"}} Jul 30 05:01:54.245993 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: method: > Jul 30 05:01:54.247861 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: exception: Invalid volume: volume 41a25d81-2695-4312-b74a-a5f51bacc1ea is already attached to instances: f27c16ec-7d74-4a2a-9b40-c95455fa8aff Jul 30 05:01:54.247861 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: action_args: {'server_id': '22fe5ad8-01f8-4d0a-bb24-7c23a427d328', 'body': {'volumeAttachment': {'volumeId': '41a25d81-2695-4312-b74a-a5f51bacc1ea'}}} Jul 30 05:01:54.247861 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 05:01:54.247861 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:01:54.247861 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 30 05:01:54.247861 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 30 05:01:54.247861 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 30 05:01:54.247861 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 30 05:01:54.247861 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 30 05:01:54.247861 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 30 05:01:54.247861 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Jul 30 05:01:54.247861 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 30 05:01:54.247861 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Jul 30 05:01:54.247861 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 30 05:01:54.247861 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 41a25d81-2695-4312-b74a-a5f51bacc1ea is already attached to instances: f27c16ec-7d74-4a2a-9b40-c95455fa8aff Jul 30 05:01:54.247861 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 05:01:54.247861 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 05:01:54.247861 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 05:01:54.247861 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:01:54.249662 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 05:01:54.249662 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 05:01:54.249662 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 05:01:54.249662 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 05:01:54.249662 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 05:01:54.249662 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 05:01:54.249662 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 05:01:54.249662 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 05:01:54.249662 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 05:01:54.249662 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 05:01:54.249662 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 05:01:54.249662 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 05:01:54.249662 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 30 05:01:54.249662 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 30 05:01:54.249662 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 41a25d81-2695-4312-b74a-a5f51bacc1ea is already attached to instances: f27c16ec-7d74-4a2a-9b40-c95455fa8aff Jul 30 05:01:54.249662 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 05:01:54.249662 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 05:01:54.249662 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 05:01:54.249662 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:01:54.249662 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 05:01:54.251165 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 05:01:54.251165 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 05:01:54.251165 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 05:01:54.251165 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 41a25d81-2695-4312-b74a-a5f51bacc1ea is already attached to instances: f27c16ec-7d74-4a2a-9b40-c95455fa8aff Jul 30 05:01:54.251165 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 05:01:54.251165 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-c8b93a5b-a99b-46c6-82e9-a6f0f920c26e tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Returning 400 to user: Invalid volume: volume 41a25d81-2695-4312-b74a-a5f51bacc1ea is already attached to instances: f27c16ec-7d74-4a2a-9b40-c95455fa8aff {{(pid=117886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 05:01:54.251165 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-c8b93a5b-a99b-46c6-82e9-a6f0f920c26e tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "POST /compute/v2.1/servers/22fe5ad8-01f8-4d0a-bb24-7c23a427d328/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.130871 Jul 30 05:01:54.251165 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 296/560] 10.222.0.20 () {60 vars in 1323 bytes} [Sat Jul 30 05:01:54 2022] POST /compute/v2.1/servers/22fe5ad8-01f8-4d0a-bb24-7c23a427d328/os-volume_attachments => generated 174 bytes in 135 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 30 05:01:54.258219 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-350618bb-89b9-4787-a04e-45c73f18e234 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:54.259096 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-350618bb-89b9-4787-a04e-45c73f18e234 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: 22fe5ad8-01f8-4d0a-bb24-7c23a427d328] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:54.270613 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-350618bb-89b9-4787-a04e-45c73f18e234 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:54.274144 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-350618bb-89b9-4787-a04e-45c73f18e234 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:54.276649 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-350618bb-89b9-4787-a04e-45c73f18e234 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:54.278331 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-350618bb-89b9-4787-a04e-45c73f18e234 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:54.321137 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-ea0b7233-c32f-4ae3-b30a-0411f67ae2e6 req-9c8d623b-5123-43cf-bb9b-b10726d84f57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdf672c0-82ac-413b-a8cc-e01a4de45c4e", "name": "network-vif-deleted", "tag": "489c2188-4f11-4296-9de5-6a7a8bb1a9dd"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:01:54.326081 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-350618bb-89b9-4787-a04e-45c73f18e234 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: 22fe5ad8-01f8-4d0a-bb24-7c23a427d328] Going to try to terminate instance {{(pid=117885) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 05:01:54.346781 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-ea0b7233-c32f-4ae3-b30a-0411f67ae2e6 req-9c8d623b-5123-43cf-bb9b-b10726d84f57 service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:54.347971 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-ea0b7233-c32f-4ae3-b30a-0411f67ae2e6 req-9c8d623b-5123-43cf-bb9b-b10726d84f57 service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:54.379884 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-ea0b7233-c32f-4ae3-b30a-0411f67ae2e6 req-9c8d623b-5123-43cf-bb9b-b10726d84f57 service nova] Creating event network-vif-deleted:489c2188-4f11-4296-9de5-6a7a8bb1a9dd for instance fdf672c0-82ac-413b-a8cc-e01a4de45c4e on hv-cinder-85127 Jul 30 05:01:54.396783 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-ea0b7233-c32f-4ae3-b30a-0411f67ae2e6 req-9c8d623b-5123-43cf-bb9b-b10726d84f57 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080706 Jul 30 05:01:54.398066 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 297/561] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Jul 30 05:01:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 05:01:54.515069 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-350618bb-89b9-4787-a04e-45c73f18e234 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "DELETE /compute/v2.1/servers/22fe5ad8-01f8-4d0a-bb24-7c23a427d328" status: 204 len: 0 microversion: 2.1 time: 0.261804 Jul 30 05:01:54.516994 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 265/562] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Jul 30 05:01:54 2022] DELETE /compute/v2.1/servers/22fe5ad8-01f8-4d0a-bb24-7c23a427d328 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 05:01:54.529614 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-bd76239f-3002-4287-92b7-4051be124295 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:54.530304 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-bd76239f-3002-4287-92b7-4051be124295 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: 22fe5ad8-01f8-4d0a-bb24-7c23a427d328] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:54.538307 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bd76239f-3002-4287-92b7-4051be124295 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:54.539070 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bd76239f-3002-4287-92b7-4051be124295 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:54.540931 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bd76239f-3002-4287-92b7-4051be124295 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:54.541626 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bd76239f-3002-4287-92b7-4051be124295 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:54.696925 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-bd76239f-3002-4287-92b7-4051be124295 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8abb58f9c274e568d2d0fe3d4df11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01500cb03c74d1082090cd1c1836169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:54.704773 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-bd76239f-3002-4287-92b7-4051be124295 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/22fe5ad8-01f8-4d0a-bb24-7c23a427d328" status: 200 len: 1682 microversion: 2.1 time: 0.181355 Jul 30 05:01:54.705577 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 298/563] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:01:54 2022] GET /compute/v2.1/servers/22fe5ad8-01f8-4d0a-bb24-7c23a427d328 => generated 1682 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:01:54.748921 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-5e91a0db-d9be-47de-bc5a-11c919db555a tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:54.749554 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-5e91a0db-d9be-47de-bc5a-11c919db555a tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] [instance: 267d974a-0a42-4e11-ada0-68e101c4a48f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:54.756501 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5e91a0db-d9be-47de-bc5a-11c919db555a tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:54.756948 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5e91a0db-d9be-47de-bc5a-11c919db555a tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:54.757712 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5e91a0db-d9be-47de-bc5a-11c919db555a tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:54.758147 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5e91a0db-d9be-47de-bc5a-11c919db555a tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:54.953800 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-5e91a0db-d9be-47de-bc5a-11c919db555a tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407ad282edd74fb1adf62fb63306779c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db365a6a9f6041a7a8749fd1a1e3d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:54.962084 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-5e91a0db-d9be-47de-bc5a-11c919db555a tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] 10.222.0.20 "GET /compute/v2.1/servers/267d974a-0a42-4e11-ada0-68e101c4a48f" status: 200 len: 1261 microversion: 2.1 time: 0.217369 Jul 30 05:01:54.965759 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 266/564] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:01:54 2022] GET /compute/v2.1/servers/267d974a-0a42-4e11-ada0-68e101c4a48f => generated 1261 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:01:55.044952 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-7447a29f-201a-4e4c-99b1-9f4c6c236adc tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:55.046125 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-7447a29f-201a-4e4c-99b1-9f4c6c236adc tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] [instance: fdf672c0-82ac-413b-a8cc-e01a4de45c4e] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:55.055675 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7447a29f-201a-4e4c-99b1-9f4c6c236adc tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:55.056131 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7447a29f-201a-4e4c-99b1-9f4c6c236adc tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:55.056915 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7447a29f-201a-4e4c-99b1-9f4c6c236adc tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:55.057362 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7447a29f-201a-4e4c-99b1-9f4c6c236adc tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:55.094947 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7447a29f-201a-4e4c-99b1-9f4c6c236adc tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:55.095404 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7447a29f-201a-4e4c-99b1-9f4c6c236adc tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:55.095991 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.objects.instance [None req-7447a29f-201a-4e4c-99b1-9f4c6c236adc tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lazy-loading 'fault' on Instance uuid fdf672c0-82ac-413b-a8cc-e01a4de45c4e {{(pid=117886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 05:01:55.103979 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-5e6b243f-5c47-4db1-82ea-76bc8a79af0f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:55.105193 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-5e6b243f-5c47-4db1-82ea-76bc8a79af0f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:55.111370 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5e6b243f-5c47-4db1-82ea-76bc8a79af0f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:55.112075 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5e6b243f-5c47-4db1-82ea-76bc8a79af0f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:55.124237 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5e6b243f-5c47-4db1-82ea-76bc8a79af0f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:55.125086 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5e6b243f-5c47-4db1-82ea-76bc8a79af0f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:55.161894 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-7447a29f-201a-4e4c-99b1-9f4c6c236adc tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334f2d8d9d9a4f7a90586999398f8a40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a02f6df4ed4365b3ce1fa970f9cf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:55.169734 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-7447a29f-201a-4e4c-99b1-9f4c6c236adc tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] 10.222.0.20 "GET /compute/v2.1/servers/fdf672c0-82ac-413b-a8cc-e01a4de45c4e" status: 200 len: 1308 microversion: 2.1 time: 0.128591 Jul 30 05:01:55.170998 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 299/565] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:01:55 2022] GET /compute/v2.1/servers/fdf672c0-82ac-413b-a8cc-e01a4de45c4e => generated 1308 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:01:55.292531 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-5e6b243f-5c47-4db1-82ea-76bc8a79af0f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:55.313559 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-5e6b243f-5c47-4db1-82ea-76bc8a79af0f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:55.315204 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-5e6b243f-5c47-4db1-82ea-76bc8a79af0f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:55.317016 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-5e6b243f-5c47-4db1-82ea-76bc8a79af0f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1808 microversion: 2.20 time: 0.216991 Jul 30 05:01:55.320192 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 267/566] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:01:55 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1808 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 05:01:55.729566 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-cf948fa1-f50f-4492-bf6f-9b03ecf977e4 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:55.730355 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-cf948fa1-f50f-4492-bf6f-9b03ecf977e4 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: 22fe5ad8-01f8-4d0a-bb24-7c23a427d328] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:55.739378 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cf948fa1-f50f-4492-bf6f-9b03ecf977e4 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:55.740027 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cf948fa1-f50f-4492-bf6f-9b03ecf977e4 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:55.740896 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cf948fa1-f50f-4492-bf6f-9b03ecf977e4 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:55.741434 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cf948fa1-f50f-4492-bf6f-9b03ecf977e4 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:55.888270 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-cf948fa1-f50f-4492-bf6f-9b03ecf977e4 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8abb58f9c274e568d2d0fe3d4df11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01500cb03c74d1082090cd1c1836169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:55.896848 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-cf948fa1-f50f-4492-bf6f-9b03ecf977e4 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/22fe5ad8-01f8-4d0a-bb24-7c23a427d328" status: 200 len: 1682 microversion: 2.1 time: 0.171496 Jul 30 05:01:55.898049 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 300/567] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:01:55 2022] GET /compute/v2.1/servers/22fe5ad8-01f8-4d0a-bb24-7c23a427d328 => generated 1682 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:01:55.983944 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-639692a8-bf11-45d3-b374-9576c587ee38 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:55.984642 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-639692a8-bf11-45d3-b374-9576c587ee38 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] [instance: 267d974a-0a42-4e11-ada0-68e101c4a48f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:55.991801 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-639692a8-bf11-45d3-b374-9576c587ee38 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:55.992498 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-639692a8-bf11-45d3-b374-9576c587ee38 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:55.993443 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-639692a8-bf11-45d3-b374-9576c587ee38 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:55.993879 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-639692a8-bf11-45d3-b374-9576c587ee38 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:56.193477 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-a84e31be-befd-4c0e-9204-eff5ecc7e0bb tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:56.194281 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-a84e31be-befd-4c0e-9204-eff5ecc7e0bb tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] [instance: fdf672c0-82ac-413b-a8cc-e01a4de45c4e] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:56.210222 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a84e31be-befd-4c0e-9204-eff5ecc7e0bb tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:56.211112 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a84e31be-befd-4c0e-9204-eff5ecc7e0bb tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:56.212188 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a84e31be-befd-4c0e-9204-eff5ecc7e0bb tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:56.212891 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a84e31be-befd-4c0e-9204-eff5ecc7e0bb tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:56.265763 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a84e31be-befd-4c0e-9204-eff5ecc7e0bb tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:56.266286 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a84e31be-befd-4c0e-9204-eff5ecc7e0bb tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:56.266859 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.objects.instance [None req-a84e31be-befd-4c0e-9204-eff5ecc7e0bb tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lazy-loading 'fault' on Instance uuid fdf672c0-82ac-413b-a8cc-e01a4de45c4e {{(pid=117886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 05:01:56.321406 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-a84e31be-befd-4c0e-9204-eff5ecc7e0bb tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334f2d8d9d9a4f7a90586999398f8a40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a02f6df4ed4365b3ce1fa970f9cf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:56.329648 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-a84e31be-befd-4c0e-9204-eff5ecc7e0bb tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] 10.222.0.20 "GET /compute/v2.1/servers/fdf672c0-82ac-413b-a8cc-e01a4de45c4e" status: 200 len: 1308 microversion: 2.1 time: 0.142585 Jul 30 05:01:56.330507 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 301/568] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:01:56 2022] GET /compute/v2.1/servers/fdf672c0-82ac-413b-a8cc-e01a4de45c4e => generated 1308 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:01:56.353872 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-1b6edf26-6b85-46bc-a544-f24f684f419f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:56.354718 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-1b6edf26-6b85-46bc-a544-f24f684f419f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:56.361919 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1b6edf26-6b85-46bc-a544-f24f684f419f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:56.363404 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1b6edf26-6b85-46bc-a544-f24f684f419f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:56.364556 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1b6edf26-6b85-46bc-a544-f24f684f419f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:56.365155 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1b6edf26-6b85-46bc-a544-f24f684f419f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:56.408837 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-639692a8-bf11-45d3-b374-9576c587ee38 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407ad282edd74fb1adf62fb63306779c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db365a6a9f6041a7a8749fd1a1e3d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:56.421504 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-639692a8-bf11-45d3-b374-9576c587ee38 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] 10.222.0.20 "GET /compute/v2.1/servers/267d974a-0a42-4e11-ada0-68e101c4a48f" status: 200 len: 1261 microversion: 2.1 time: 0.441296 Jul 30 05:01:56.422400 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 268/569] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:01:55 2022] GET /compute/v2.1/servers/267d974a-0a42-4e11-ada0-68e101c4a48f => generated 1261 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:01:56.548520 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-1b6edf26-6b85-46bc-a544-f24f684f419f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:56.569786 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-1b6edf26-6b85-46bc-a544-f24f684f419f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:56.572133 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-1b6edf26-6b85-46bc-a544-f24f684f419f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:56.575717 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-1b6edf26-6b85-46bc-a544-f24f684f419f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1808 microversion: 2.20 time: 0.229015 Jul 30 05:01:56.576374 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 302/570] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:01:56 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1808 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 05:01:56.920297 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-67db6fd4-e25f-4c0e-ae28-22236cbc4d6e tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:56.921726 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-67db6fd4-e25f-4c0e-ae28-22236cbc4d6e tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: 22fe5ad8-01f8-4d0a-bb24-7c23a427d328] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:56.930273 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-67db6fd4-e25f-4c0e-ae28-22236cbc4d6e tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:56.930855 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-67db6fd4-e25f-4c0e-ae28-22236cbc4d6e tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:56.931715 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-67db6fd4-e25f-4c0e-ae28-22236cbc4d6e tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:56.932235 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-67db6fd4-e25f-4c0e-ae28-22236cbc4d6e tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:57.100517 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-67db6fd4-e25f-4c0e-ae28-22236cbc4d6e tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8abb58f9c274e568d2d0fe3d4df11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01500cb03c74d1082090cd1c1836169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:57.132122 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-67db6fd4-e25f-4c0e-ae28-22236cbc4d6e tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/22fe5ad8-01f8-4d0a-bb24-7c23a427d328" status: 200 len: 1682 microversion: 2.1 time: 0.215690 Jul 30 05:01:57.136209 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 269/571] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:01:56 2022] GET /compute/v2.1/servers/22fe5ad8-01f8-4d0a-bb24-7c23a427d328 => generated 1682 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:01:57.355961 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-71ff63f1-6582-4b63-9da9-f69b9250766c tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:57.357486 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-71ff63f1-6582-4b63-9da9-f69b9250766c tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] [instance: fdf672c0-82ac-413b-a8cc-e01a4de45c4e] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:57.368820 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-71ff63f1-6582-4b63-9da9-f69b9250766c tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:57.369712 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-71ff63f1-6582-4b63-9da9-f69b9250766c tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:57.371620 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-71ff63f1-6582-4b63-9da9-f69b9250766c tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:57.372327 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-71ff63f1-6582-4b63-9da9-f69b9250766c tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:57.407698 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.wsgi [None req-71ff63f1-6582-4b63-9da9-f69b9250766c tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] HTTP exception thrown: Instance fdf672c0-82ac-413b-a8cc-e01a4de45c4e could not be found. Jul 30 05:01:57.409415 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-71ff63f1-6582-4b63-9da9-f69b9250766c tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Request method failure captured: Jul 30 05:01:57.409415 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: request: GET /compute/v2.1/servers/fdf672c0-82ac-413b-a8cc-e01a4de45c4e HTTP/1.1 Jul 30 05:01:57.409415 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Accept: application/json Jul 30 05:01:57.409415 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Accept-Encoding: identity Jul 30 05:01:57.409415 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Connection: close Jul 30 05:01:57.409415 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Content-Length: 0 Jul 30 05:01:57.409415 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Content-Type: application/json Jul 30 05:01:57.409415 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Host: 10.222.0.20 Jul 30 05:01:57.409415 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Openstack-System-Scope: None Jul 30 05:01:57.409415 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: User-Agent: python-urllib3/1.26.10 Jul 30 05:01:57.409415 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Auth-Token: gAAAAABi5Lrm9FZsrUOAsTeBfld8u4OciBEK5QiQywF6Zh6BUEe3qrnBNy8P-yM6Vv9fynfUSwn-IdQR7erkPA2b3Ffp9HhiQipqchvi9YTJCF3mKWvyu8L3ttC80Fe5oGlsrLYTYTUc5P9TlAvO9s2ieDGZTqpqHnbohUPMN2_5bQuT9D58V6Y Jul 30 05:01:57.409415 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Domain-Id: None Jul 30 05:01:57.409415 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Domain-Name: None Jul 30 05:01:57.409415 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Identity-Status: Confirmed Jul 30 05:01:57.409415 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Is-Admin-Project: True Jul 30 05:01:57.409415 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Project-Domain-Id: default Jul 30 05:01:57.409415 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Project-Domain-Name: Default Jul 30 05:01:57.409415 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Project-Id: a6a02f6df4ed4365b3ce1fa970f9cf41 Jul 30 05:01:57.409415 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1525543449 Jul 30 05:01:57.409415 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Role: member,reader Jul 30 05:01:57.409415 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Roles: member,reader Jul 30 05:01:57.412540 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a6a02f6df4ed4365b3ce1fa970f9cf41"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a6a02f6df4ed4365b3ce1fa970f9cf41"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a6a02f6df4ed4365b3ce1fa970f9cf41"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a6a02f6df4ed4365b3ce1fa970f9cf41"}]}] Jul 30 05:01:57.412540 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Tenant: tempest-VolumesSnapshotTestJSON-1525543449 Jul 30 05:01:57.412540 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Tenant-Id: a6a02f6df4ed4365b3ce1fa970f9cf41 Jul 30 05:01:57.412540 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1525543449 Jul 30 05:01:57.412540 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User: tempest-VolumesSnapshotTestJSON-1525543449-project Jul 30 05:01:57.412540 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User-Domain-Id: default Jul 30 05:01:57.412540 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User-Domain-Name: Default Jul 30 05:01:57.412540 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User-Id: 334f2d8d9d9a4f7a90586999398f8a40 Jul 30 05:01:57.412540 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User-Name: tempest-VolumesSnapshotTestJSON-1525543449-project Jul 30 05:01:57.412540 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: method: > Jul 30 05:01:57.412540 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: exception: Instance fdf672c0-82ac-413b-a8cc-e01a4de45c4e could not be found. Jul 30 05:01:57.412540 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: action_args: {'id': 'fdf672c0-82ac-413b-a8cc-e01a4de45c4e'} Jul 30 05:01:57.413378 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 05:01:57.413378 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:01:57.413378 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 05:01:57.413378 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 05:01:57.413378 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 05:01:57.413378 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 05:01:57.413378 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 05:01:57.413378 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 05:01:57.413378 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 05:01:57.413378 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 05:01:57.413378 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fdf672c0-82ac-413b-a8cc-e01a4de45c4e could not be found. Jul 30 05:01:57.413378 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 05:01:57.413378 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 05:01:57.413378 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 05:01:57.413378 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:01:57.413378 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 05:01:57.413378 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 05:01:57.413378 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 05:01:57.413378 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 05:01:57.413378 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 05:01:57.414657 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 05:01:57.414657 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 05:01:57.414657 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 05:01:57.414657 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 05:01:57.414657 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 05:01:57.414657 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 05:01:57.414657 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 05:01:57.414657 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fdf672c0-82ac-413b-a8cc-e01a4de45c4e could not be found. Jul 30 05:01:57.414657 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 05:01:57.414657 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 05:01:57.414657 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 05:01:57.414657 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:01:57.414657 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 05:01:57.414657 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 05:01:57.414657 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 05:01:57.414657 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 05:01:57.414657 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fdf672c0-82ac-413b-a8cc-e01a4de45c4e could not be found. Jul 30 05:01:57.414657 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 05:01:57.415825 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-71ff63f1-6582-4b63-9da9-f69b9250766c tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Returning 404 to user: Instance fdf672c0-82ac-413b-a8cc-e01a4de45c4e could not be found. {{(pid=117886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 05:01:57.415825 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-71ff63f1-6582-4b63-9da9-f69b9250766c tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] 10.222.0.20 "GET /compute/v2.1/servers/fdf672c0-82ac-413b-a8cc-e01a4de45c4e" status: 404 len: 111 microversion: 2.1 time: 0.063322 Jul 30 05:01:57.415825 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 303/572] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:01:57 2022] GET /compute/v2.1/servers/fdf672c0-82ac-413b-a8cc-e01a4de45c4e => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 05:01:57.444576 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-efbf7d5d-4a26-4f2f-9269-c766f3ca554a tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:57.445983 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-efbf7d5d-4a26-4f2f-9269-c766f3ca554a tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] [instance: 267d974a-0a42-4e11-ada0-68e101c4a48f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:57.453681 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-efbf7d5d-4a26-4f2f-9269-c766f3ca554a tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:57.455101 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-efbf7d5d-4a26-4f2f-9269-c766f3ca554a tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:57.457269 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-efbf7d5d-4a26-4f2f-9269-c766f3ca554a tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:57.457914 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-efbf7d5d-4a26-4f2f-9269-c766f3ca554a tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:57.608134 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-2d479b70-05ef-41b4-b3a1-cfbd0ce07ec4 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:57.608762 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-2d479b70-05ef-41b4-b3a1-cfbd0ce07ec4 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:57.625109 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2d479b70-05ef-41b4-b3a1-cfbd0ce07ec4 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:57.625821 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2d479b70-05ef-41b4-b3a1-cfbd0ce07ec4 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:57.626944 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2d479b70-05ef-41b4-b3a1-cfbd0ce07ec4 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:57.629054 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2d479b70-05ef-41b4-b3a1-cfbd0ce07ec4 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:57.706214 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-efbf7d5d-4a26-4f2f-9269-c766f3ca554a tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407ad282edd74fb1adf62fb63306779c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db365a6a9f6041a7a8749fd1a1e3d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:57.715290 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-efbf7d5d-4a26-4f2f-9269-c766f3ca554a tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] 10.222.0.20 "GET /compute/v2.1/servers/267d974a-0a42-4e11-ada0-68e101c4a48f" status: 200 len: 1261 microversion: 2.1 time: 0.275623 Jul 30 05:01:57.729244 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 270/573] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:01:57 2022] GET /compute/v2.1/servers/267d974a-0a42-4e11-ada0-68e101c4a48f => generated 1261 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:01:57.915882 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-2d479b70-05ef-41b4-b3a1-cfbd0ce07ec4 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:57.925299 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-2d479b70-05ef-41b4-b3a1-cfbd0ce07ec4 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:57.931741 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-2d479b70-05ef-41b4-b3a1-cfbd0ce07ec4 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:57.936099 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-2d479b70-05ef-41b4-b3a1-cfbd0ce07ec4 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1808 microversion: 2.20 time: 0.331934 Jul 30 05:01:57.940120 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 304/574] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:01:57 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1808 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 05:01:58.154753 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-33ff0880-561a-4c55-b77a-e1d253952a2e tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:58.155992 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-33ff0880-561a-4c55-b77a-e1d253952a2e tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: 22fe5ad8-01f8-4d0a-bb24-7c23a427d328] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:58.168223 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-d2d27911-b5f4-42b8-970e-495889a4d099 req-fae733d1-55ee-4bab-a993-0396676912c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22fe5ad8-01f8-4d0a-bb24-7c23a427d328", "name": "network-vif-deleted", "tag": "067511f8-7ca6-4d74-8168-37c6673684c1"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:01:58.170784 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-33ff0880-561a-4c55-b77a-e1d253952a2e tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:58.171358 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-33ff0880-561a-4c55-b77a-e1d253952a2e tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:58.172652 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-33ff0880-561a-4c55-b77a-e1d253952a2e tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:58.173209 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-33ff0880-561a-4c55-b77a-e1d253952a2e tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:58.180384 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-d2d27911-b5f4-42b8-970e-495889a4d099 req-fae733d1-55ee-4bab-a993-0396676912c1 service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:58.180699 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-d2d27911-b5f4-42b8-970e-495889a4d099 req-fae733d1-55ee-4bab-a993-0396676912c1 service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:58.194056 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-d2d27911-b5f4-42b8-970e-495889a4d099 req-fae733d1-55ee-4bab-a993-0396676912c1 service nova] Creating event network-vif-deleted:067511f8-7ca6-4d74-8168-37c6673684c1 for instance 22fe5ad8-01f8-4d0a-bb24-7c23a427d328 on hv-cinder-85127 Jul 30 05:01:58.199642 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-d2d27911-b5f4-42b8-970e-495889a4d099 req-fae733d1-55ee-4bab-a993-0396676912c1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034939 Jul 30 05:01:58.200444 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 305/575] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Jul 30 05:01:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 05:01:58.315445 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-33ff0880-561a-4c55-b77a-e1d253952a2e tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8abb58f9c274e568d2d0fe3d4df11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01500cb03c74d1082090cd1c1836169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:58.321574 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:01:58.330642 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-33ff0880-561a-4c55-b77a-e1d253952a2e tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/22fe5ad8-01f8-4d0a-bb24-7c23a427d328" status: 200 len: 1614 microversion: 2.1 time: 0.181073 Jul 30 05:01:58.334751 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 271/576] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:01:58 2022] GET /compute/v2.1/servers/22fe5ad8-01f8-4d0a-bb24-7c23a427d328 => generated 1614 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:01:58.739116 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-a95cbe9d-7872-46ba-957d-c74e6e28bc8b tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:58.740437 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-a95cbe9d-7872-46ba-957d-c74e6e28bc8b tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] [instance: 267d974a-0a42-4e11-ada0-68e101c4a48f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:58.754514 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a95cbe9d-7872-46ba-957d-c74e6e28bc8b tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:58.755152 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a95cbe9d-7872-46ba-957d-c74e6e28bc8b tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:58.756135 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a95cbe9d-7872-46ba-957d-c74e6e28bc8b tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:58.756731 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a95cbe9d-7872-46ba-957d-c74e6e28bc8b tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:58.966271 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-b22118dc-0576-4149-9f6c-bb9ebdac77e1 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:58.980642 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-b22118dc-0576-4149-9f6c-bb9ebdac77e1 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:58.993535 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b22118dc-0576-4149-9f6c-bb9ebdac77e1 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:59.008569 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b22118dc-0576-4149-9f6c-bb9ebdac77e1 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:59.011415 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b22118dc-0576-4149-9f6c-bb9ebdac77e1 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:59.012091 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b22118dc-0576-4149-9f6c-bb9ebdac77e1 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:59.129930 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-a95cbe9d-7872-46ba-957d-c74e6e28bc8b tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407ad282edd74fb1adf62fb63306779c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db365a6a9f6041a7a8749fd1a1e3d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:59.139485 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-a95cbe9d-7872-46ba-957d-c74e6e28bc8b tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] 10.222.0.20 "GET /compute/v2.1/servers/267d974a-0a42-4e11-ada0-68e101c4a48f" status: 200 len: 1261 microversion: 2.1 time: 0.405145 Jul 30 05:01:59.140831 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 306/577] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:01:58 2022] GET /compute/v2.1/servers/267d974a-0a42-4e11-ada0-68e101c4a48f => generated 1261 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:01:59.285561 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-b22118dc-0576-4149-9f6c-bb9ebdac77e1 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:59.296518 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-b22118dc-0576-4149-9f6c-bb9ebdac77e1 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:59.298309 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-b22118dc-0576-4149-9f6c-bb9ebdac77e1 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:59.299681 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-b22118dc-0576-4149-9f6c-bb9ebdac77e1 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1808 microversion: 2.20 time: 0.337401 Jul 30 05:01:59.300943 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 272/578] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:01:58 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1808 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 05:01:59.353987 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-1478893b-1b15-49fd-8994-8a6a50072e27 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:01:59.354744 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-1478893b-1b15-49fd-8994-8a6a50072e27 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: 22fe5ad8-01f8-4d0a-bb24-7c23a427d328] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:01:59.368304 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1478893b-1b15-49fd-8994-8a6a50072e27 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:59.368786 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1478893b-1b15-49fd-8994-8a6a50072e27 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:59.369580 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1478893b-1b15-49fd-8994-8a6a50072e27 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:01:59.370211 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1478893b-1b15-49fd-8994-8a6a50072e27 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:01:59.462643 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-1478893b-1b15-49fd-8994-8a6a50072e27 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8abb58f9c274e568d2d0fe3d4df11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01500cb03c74d1082090cd1c1836169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:01:59.478259 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-1478893b-1b15-49fd-8994-8a6a50072e27 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/22fe5ad8-01f8-4d0a-bb24-7c23a427d328" status: 200 len: 1326 microversion: 2.1 time: 0.127959 Jul 30 05:01:59.479287 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 307/579] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:01:59 2022] GET /compute/v2.1/servers/22fe5ad8-01f8-4d0a-bb24-7c23a427d328 => generated 1326 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:02:00.107957 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-650d6fbd-8dc6-4da2-bea5-e2ef21e8effd req-adc6e1c8-f37c-4717-86ed-82e2f339ace1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4370e65-bec4-454f-9566-33ff60441229", "name": "network-vif-plugged", "status": "completed", "tag": "77f9d403-dee8-430d-8122-9a468f943da2"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:02:00.133896 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-650d6fbd-8dc6-4da2-bea5-e2ef21e8effd req-adc6e1c8-f37c-4717-86ed-82e2f339ace1 service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:00.134350 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-650d6fbd-8dc6-4da2-bea5-e2ef21e8effd req-adc6e1c8-f37c-4717-86ed-82e2f339ace1 service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:00.164452 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-650d6fbd-8dc6-4da2-bea5-e2ef21e8effd req-adc6e1c8-f37c-4717-86ed-82e2f339ace1 service nova] Creating event network-vif-plugged:77f9d403-dee8-430d-8122-9a468f943da2 for instance e4370e65-bec4-454f-9566-33ff60441229 on hv-cinder-85127 Jul 30 05:02:00.166415 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-d3354227-21af-4ba2-a492-747df00f8732 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:02:00.167652 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-d3354227-21af-4ba2-a492-747df00f8732 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] [instance: 267d974a-0a42-4e11-ada0-68e101c4a48f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:02:00.172555 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-650d6fbd-8dc6-4da2-bea5-e2ef21e8effd req-adc6e1c8-f37c-4717-86ed-82e2f339ace1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068175 Jul 30 05:02:00.175829 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 273/580] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Jul 30 05:02:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 05:02:00.177852 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d3354227-21af-4ba2-a492-747df00f8732 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:00.178587 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d3354227-21af-4ba2-a492-747df00f8732 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:00.179587 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d3354227-21af-4ba2-a492-747df00f8732 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:00.180239 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d3354227-21af-4ba2-a492-747df00f8732 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:00.245357 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-59356287-2cab-4291-b036-e99e6f54247b tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d413de6f-e0d4-4e0d-958b-99855c762397"}} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:02:00.247843 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-59356287-2cab-4291-b036-e99e6f54247b tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 65b7a5ff-be03-4f45-941c-26a50cdabf02] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:02:00.266558 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-59356287-2cab-4291-b036-e99e6f54247b tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:00.267025 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-59356287-2cab-4291-b036-e99e6f54247b tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:00.267817 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-59356287-2cab-4291-b036-e99e6f54247b tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:00.268260 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-59356287-2cab-4291-b036-e99e6f54247b tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:00.372329 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-d3354227-21af-4ba2-a492-747df00f8732 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407ad282edd74fb1adf62fb63306779c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db365a6a9f6041a7a8749fd1a1e3d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:02:00.380856 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-d3354227-21af-4ba2-a492-747df00f8732 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] 10.222.0.20 "GET /compute/v2.1/servers/267d974a-0a42-4e11-ada0-68e101c4a48f" status: 200 len: 1261 microversion: 2.1 time: 0.218895 Jul 30 05:02:00.381961 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 308/581] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:02:00 2022] GET /compute/v2.1/servers/267d974a-0a42-4e11-ada0-68e101c4a48f => generated 1261 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 05:02:00.388771 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-7fe52828-6beb-47eb-8212-a45c49872b06 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:02:00.389469 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-7fe52828-6beb-47eb-8212-a45c49872b06 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:02:00.397046 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7fe52828-6beb-47eb-8212-a45c49872b06 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:00.397737 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7fe52828-6beb-47eb-8212-a45c49872b06 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:00.398695 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7fe52828-6beb-47eb-8212-a45c49872b06 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:00.399283 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7fe52828-6beb-47eb-8212-a45c49872b06 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:00.575218 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-7fe52828-6beb-47eb-8212-a45c49872b06 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:02:00.579677 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=100 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:02:00.587396 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-7fe52828-6beb-47eb-8212-a45c49872b06 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:02:00.589558 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-7fe52828-6beb-47eb-8212-a45c49872b06 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:02:00.591434 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-7fe52828-6beb-47eb-8212-a45c49872b06 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1808 microversion: 2.20 time: 0.208405 Jul 30 05:02:00.592376 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 309/582] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:02:00 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1808 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 05:02:00.597820 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-4603f376-3c74-4615-a3b7-170c254019cb tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:02:00.598749 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-4603f376-3c74-4615-a3b7-170c254019cb tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: 22fe5ad8-01f8-4d0a-bb24-7c23a427d328] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:02:00.606830 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4603f376-3c74-4615-a3b7-170c254019cb tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:00.607841 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4603f376-3c74-4615-a3b7-170c254019cb tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:00.609201 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4603f376-3c74-4615-a3b7-170c254019cb tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:00.609830 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4603f376-3c74-4615-a3b7-170c254019cb tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:00.690011 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-4603f376-3c74-4615-a3b7-170c254019cb tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8abb58f9c274e568d2d0fe3d4df11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01500cb03c74d1082090cd1c1836169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:02:00.699264 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-4603f376-3c74-4615-a3b7-170c254019cb tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/22fe5ad8-01f8-4d0a-bb24-7c23a427d328" status: 200 len: 1326 microversion: 2.1 time: 0.105379 Jul 30 05:02:00.700368 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 310/583] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:02:00 2022] GET /compute/v2.1/servers/22fe5ad8-01f8-4d0a-bb24-7c23a427d328 => generated 1326 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:02:01.404423 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-9cb6eb34-28ae-4d0c-bcd6-a72004dee778 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:02:01.405131 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-9cb6eb34-28ae-4d0c-bcd6-a72004dee778 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] [instance: 267d974a-0a42-4e11-ada0-68e101c4a48f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:02:01.413084 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9cb6eb34-28ae-4d0c-bcd6-a72004dee778 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:01.413543 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9cb6eb34-28ae-4d0c-bcd6-a72004dee778 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:01.414640 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9cb6eb34-28ae-4d0c-bcd6-a72004dee778 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:01.415086 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9cb6eb34-28ae-4d0c-bcd6-a72004dee778 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:01.562905 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-9cb6eb34-28ae-4d0c-bcd6-a72004dee778 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407ad282edd74fb1adf62fb63306779c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db365a6a9f6041a7a8749fd1a1e3d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:02:01.572267 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-9cb6eb34-28ae-4d0c-bcd6-a72004dee778 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] 10.222.0.20 "GET /compute/v2.1/servers/267d974a-0a42-4e11-ada0-68e101c4a48f" status: 200 len: 1261 microversion: 2.1 time: 0.172113 Jul 30 05:02:01.574476 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 311/584] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:02:01 2022] GET /compute/v2.1/servers/267d974a-0a42-4e11-ada0-68e101c4a48f => generated 1261 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 05:02:01.617349 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-260948e4-5010-4ee0-86a4-cb0ff76a3bde tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:02:01.618408 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-260948e4-5010-4ee0-86a4-cb0ff76a3bde tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:02:01.624785 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-260948e4-5010-4ee0-86a4-cb0ff76a3bde tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:01.625234 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-260948e4-5010-4ee0-86a4-cb0ff76a3bde tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:01.626007 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-260948e4-5010-4ee0-86a4-cb0ff76a3bde tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:01.626647 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-260948e4-5010-4ee0-86a4-cb0ff76a3bde tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:01.779907 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-260948e4-5010-4ee0-86a4-cb0ff76a3bde tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:02:01.790225 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-260948e4-5010-4ee0-86a4-cb0ff76a3bde tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:02:01.791993 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-260948e4-5010-4ee0-86a4-cb0ff76a3bde tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:02:01.793232 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-260948e4-5010-4ee0-86a4-cb0ff76a3bde tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1808 microversion: 2.20 time: 0.180822 Jul 30 05:02:01.794350 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 312/585] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:02:01 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1808 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 05:02:01.816140 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-71966a8b-091f-4994-a4a5-13d21f5ebbd6 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:02:01.816812 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-71966a8b-091f-4994-a4a5-13d21f5ebbd6 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: 22fe5ad8-01f8-4d0a-bb24-7c23a427d328] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:02:01.823297 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-71966a8b-091f-4994-a4a5-13d21f5ebbd6 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:01.823819 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-71966a8b-091f-4994-a4a5-13d21f5ebbd6 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:01.824686 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-71966a8b-091f-4994-a4a5-13d21f5ebbd6 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:01.825206 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-71966a8b-091f-4994-a4a5-13d21f5ebbd6 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:01.880737 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-71966a8b-091f-4994-a4a5-13d21f5ebbd6 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:01.881312 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-71966a8b-091f-4994-a4a5-13d21f5ebbd6 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:01.881801 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.objects.instance [None req-71966a8b-091f-4994-a4a5-13d21f5ebbd6 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lazy-loading 'fault' on Instance uuid 22fe5ad8-01f8-4d0a-bb24-7c23a427d328 {{(pid=117886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 05:02:01.945392 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-71966a8b-091f-4994-a4a5-13d21f5ebbd6 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8abb58f9c274e568d2d0fe3d4df11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01500cb03c74d1082090cd1c1836169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:02:01.981923 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-71966a8b-091f-4994-a4a5-13d21f5ebbd6 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/22fe5ad8-01f8-4d0a-bb24-7c23a427d328" status: 200 len: 1331 microversion: 2.1 time: 0.170883 Jul 30 05:02:01.983386 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 313/586] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:02:01 2022] GET /compute/v2.1/servers/22fe5ad8-01f8-4d0a-bb24-7c23a427d328 => generated 1331 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:02:02.555503 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-59356287-2cab-4291-b036-e99e6f54247b tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "POST /compute/v2.1/servers/65b7a5ff-be03-4f45-941c-26a50cdabf02/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.314277 Jul 30 05:02:02.556384 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 274/587] 10.222.0.20 () {60 vars in 1323 bytes} [Sat Jul 30 05:02:00 2022] POST /compute/v2.1/servers/65b7a5ff-be03-4f45-941c-26a50cdabf02/os-volume_attachments => generated 194 bytes in 2316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 05:02:02.597816 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-8fe4c73e-2e37-448c-b002-382a3ba25130 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:02:02.598798 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-8fe4c73e-2e37-448c-b002-382a3ba25130 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] [instance: 267d974a-0a42-4e11-ada0-68e101c4a48f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:02:02.606137 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8fe4c73e-2e37-448c-b002-382a3ba25130 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:02.606638 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8fe4c73e-2e37-448c-b002-382a3ba25130 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:02.607844 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8fe4c73e-2e37-448c-b002-382a3ba25130 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:02.608285 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8fe4c73e-2e37-448c-b002-382a3ba25130 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:02.822480 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-4e07b727-1e94-4e84-a380-7095ca0b61f8 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:02:02.823444 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-4e07b727-1e94-4e84-a380-7095ca0b61f8 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:02:02.833877 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4e07b727-1e94-4e84-a380-7095ca0b61f8 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:02.835224 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4e07b727-1e94-4e84-a380-7095ca0b61f8 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:02.835648 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4e07b727-1e94-4e84-a380-7095ca0b61f8 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:02.836241 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4e07b727-1e94-4e84-a380-7095ca0b61f8 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:02.953810 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-8fe4c73e-2e37-448c-b002-382a3ba25130 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407ad282edd74fb1adf62fb63306779c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db365a6a9f6041a7a8749fd1a1e3d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:02:02.967089 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-8fe4c73e-2e37-448c-b002-382a3ba25130 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] 10.222.0.20 "GET /compute/v2.1/servers/267d974a-0a42-4e11-ada0-68e101c4a48f" status: 200 len: 1261 microversion: 2.1 time: 0.373342 Jul 30 05:02:02.979381 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 314/588] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:02:02 2022] GET /compute/v2.1/servers/267d974a-0a42-4e11-ada0-68e101c4a48f => generated 1261 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:02:03.013288 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-8066545e-7b78-4857-bbda-194048ff1dbf tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:02:03.014177 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-8066545e-7b78-4857-bbda-194048ff1dbf tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: 22fe5ad8-01f8-4d0a-bb24-7c23a427d328] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:02:03.015581 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-4e07b727-1e94-4e84-a380-7095ca0b61f8 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:02:03.029440 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-4e07b727-1e94-4e84-a380-7095ca0b61f8 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:02:03.030076 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8066545e-7b78-4857-bbda-194048ff1dbf tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:03.030581 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8066545e-7b78-4857-bbda-194048ff1dbf tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:03.031229 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-4e07b727-1e94-4e84-a380-7095ca0b61f8 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:02:03.031367 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8066545e-7b78-4857-bbda-194048ff1dbf tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:03.031790 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8066545e-7b78-4857-bbda-194048ff1dbf tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:03.032935 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-4e07b727-1e94-4e84-a380-7095ca0b61f8 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1808 microversion: 2.20 time: 0.217014 Jul 30 05:02:03.046538 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 275/589] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:02:02 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1808 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 05:02:03.050244 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.wsgi [None req-8066545e-7b78-4857-bbda-194048ff1dbf tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] HTTP exception thrown: Instance 22fe5ad8-01f8-4d0a-bb24-7c23a427d328 could not be found. Jul 30 05:02:03.052302 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-8066545e-7b78-4857-bbda-194048ff1dbf tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Request method failure captured: Jul 30 05:02:03.052302 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: request: GET /compute/v2.1/servers/22fe5ad8-01f8-4d0a-bb24-7c23a427d328 HTTP/1.1 Jul 30 05:02:03.052302 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Accept: application/json Jul 30 05:02:03.052302 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Accept-Encoding: identity Jul 30 05:02:03.052302 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Connection: close Jul 30 05:02:03.052302 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Content-Length: 0 Jul 30 05:02:03.052302 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Content-Type: application/json Jul 30 05:02:03.052302 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Host: 10.222.0.20 Jul 30 05:02:03.052302 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Openstack-System-Scope: None Jul 30 05:02:03.052302 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: User-Agent: python-urllib3/1.26.10 Jul 30 05:02:03.052302 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Auth-Token: gAAAAABi5LpsOyvntIvMWRkdgHAWaqLWWQheVZGRSyU7m8d_2qr8zQQH3DOakkgVq23Q75nTB9odGI0F-DQpTcNmJESi7-iRiz2-Pz62AvInyIstK7nwhx7nj-QdimoRc10ZS0jEzNztVniYwiMWef1RbG0o7cJ-tzIv7p3eOvqZTnGZgHQkQhc Jul 30 05:02:03.052302 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Domain-Id: None Jul 30 05:02:03.052302 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Domain-Name: None Jul 30 05:02:03.052302 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Identity-Status: Confirmed Jul 30 05:02:03.052302 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Is-Admin-Project: True Jul 30 05:02:03.052302 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Project-Domain-Id: default Jul 30 05:02:03.052302 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Project-Domain-Name: Default Jul 30 05:02:03.052302 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Project-Id: e01500cb03c74d1082090cd1c1836169 Jul 30 05:02:03.052302 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Project-Name: tempest-AttachVolumeNegativeTest-490621097 Jul 30 05:02:03.052302 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Role: member,reader Jul 30 05:02:03.052302 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Roles: member,reader Jul 30 05:02:03.053777 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e01500cb03c74d1082090cd1c1836169"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e01500cb03c74d1082090cd1c1836169"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e01500cb03c74d1082090cd1c1836169"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e01500cb03c74d1082090cd1c1836169"}]}] Jul 30 05:02:03.053777 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Tenant: tempest-AttachVolumeNegativeTest-490621097 Jul 30 05:02:03.053777 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Tenant-Id: e01500cb03c74d1082090cd1c1836169 Jul 30 05:02:03.053777 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-490621097 Jul 30 05:02:03.053777 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User: tempest-AttachVolumeNegativeTest-490621097-project Jul 30 05:02:03.053777 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User-Domain-Id: default Jul 30 05:02:03.053777 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User-Domain-Name: Default Jul 30 05:02:03.053777 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User-Id: a8abb58f9c274e568d2d0fe3d4df11de Jul 30 05:02:03.053777 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User-Name: tempest-AttachVolumeNegativeTest-490621097-project Jul 30 05:02:03.053777 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: method: > Jul 30 05:02:03.053777 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: exception: Instance 22fe5ad8-01f8-4d0a-bb24-7c23a427d328 could not be found. Jul 30 05:02:03.053777 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: action_args: {'id': '22fe5ad8-01f8-4d0a-bb24-7c23a427d328'} Jul 30 05:02:03.054589 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 05:02:03.054589 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:02:03.054589 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 05:02:03.054589 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 05:02:03.054589 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 05:02:03.054589 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 05:02:03.054589 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 05:02:03.054589 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 05:02:03.054589 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 05:02:03.054589 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 05:02:03.054589 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22fe5ad8-01f8-4d0a-bb24-7c23a427d328 could not be found. Jul 30 05:02:03.054589 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 05:02:03.054589 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 05:02:03.054589 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 05:02:03.054589 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:02:03.054589 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 05:02:03.054589 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 05:02:03.054589 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 05:02:03.054589 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 05:02:03.054589 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 05:02:03.056450 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 05:02:03.056450 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 05:02:03.056450 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 05:02:03.056450 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 05:02:03.056450 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 05:02:03.056450 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 05:02:03.056450 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 05:02:03.056450 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22fe5ad8-01f8-4d0a-bb24-7c23a427d328 could not be found. Jul 30 05:02:03.056450 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 05:02:03.056450 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 05:02:03.056450 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 05:02:03.056450 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:02:03.056450 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 05:02:03.056450 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 05:02:03.056450 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 05:02:03.056450 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 05:02:03.056450 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22fe5ad8-01f8-4d0a-bb24-7c23a427d328 could not be found. Jul 30 05:02:03.056450 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 05:02:03.059209 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-8066545e-7b78-4857-bbda-194048ff1dbf tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Returning 404 to user: Instance 22fe5ad8-01f8-4d0a-bb24-7c23a427d328 could not be found. {{(pid=117886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 05:02:03.059209 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-8066545e-7b78-4857-bbda-194048ff1dbf tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/22fe5ad8-01f8-4d0a-bb24-7c23a427d328" status: 404 len: 111 microversion: 2.1 time: 0.051119 Jul 30 05:02:03.059209 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 315/590] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:02:03 2022] GET /compute/v2.1/servers/22fe5ad8-01f8-4d0a-bb24-7c23a427d328 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 05:02:03.064549 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-e39e1070-797e-48d6-baaa-93f5413c616e tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '.version_select at 0x7f2daf7f30d0>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:02:03.087408 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-e39e1070-797e-48d6-baaa-93f5413c616e tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-790956935" status: 202 len: 0 microversion: 2.1 time: 0.026340 Jul 30 05:02:03.087966 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 276/591] 10.222.0.20 () {58 vars in 1218 bytes} [Sat Jul 30 05:02:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-790956935 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 05:02:03.993004 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-7e765392-618b-4775-a4d9-9240bf915511 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:02:03.993810 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-7e765392-618b-4775-a4d9-9240bf915511 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] [instance: 267d974a-0a42-4e11-ada0-68e101c4a48f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:02:04.002426 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7e765392-618b-4775-a4d9-9240bf915511 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:04.003795 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7e765392-618b-4775-a4d9-9240bf915511 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:04.004902 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7e765392-618b-4775-a4d9-9240bf915511 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:04.005515 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7e765392-618b-4775-a4d9-9240bf915511 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:04.038139 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-4ab6044d-6a53-4a11-b9ec-9eb81f0b6f04 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:02:04.038738 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-4ab6044d-6a53-4a11-b9ec-9eb81f0b6f04 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: f27c16ec-7d74-4a2a-9b40-c95455fa8aff] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:02:04.046555 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4ab6044d-6a53-4a11-b9ec-9eb81f0b6f04 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:04.047037 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4ab6044d-6a53-4a11-b9ec-9eb81f0b6f04 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:04.047996 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4ab6044d-6a53-4a11-b9ec-9eb81f0b6f04 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:04.048594 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4ab6044d-6a53-4a11-b9ec-9eb81f0b6f04 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:04.161162 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.objects.instance [None req-4ab6044d-6a53-4a11-b9ec-9eb81f0b6f04 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lazy-loading 'services' on Instance uuid f27c16ec-7d74-4a2a-9b40-c95455fa8aff {{(pid=117885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 05:02:04.162135 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-7e765392-618b-4775-a4d9-9240bf915511 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407ad282edd74fb1adf62fb63306779c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db365a6a9f6041a7a8749fd1a1e3d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:02:04.174602 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-7e765392-618b-4775-a4d9-9240bf915511 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] 10.222.0.20 "GET /compute/v2.1/servers/267d974a-0a42-4e11-ada0-68e101c4a48f" status: 200 len: 1261 microversion: 2.1 time: 0.186622 Jul 30 05:02:04.175991 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 316/592] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:02:03 2022] GET /compute/v2.1/servers/267d974a-0a42-4e11-ada0-68e101c4a48f => generated 1261 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:02:04.180845 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-f49b0bbb-84ee-449f-b25f-7c84f9afce8e tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:02:04.181636 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-f49b0bbb-84ee-449f-b25f-7c84f9afce8e tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:02:04.188583 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f49b0bbb-84ee-449f-b25f-7c84f9afce8e tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:04.189047 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f49b0bbb-84ee-449f-b25f-7c84f9afce8e tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:04.189935 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f49b0bbb-84ee-449f-b25f-7c84f9afce8e tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:04.190258 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f49b0bbb-84ee-449f-b25f-7c84f9afce8e tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:04.253266 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-4ab6044d-6a53-4a11-b9ec-9eb81f0b6f04 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff/os-volume_attachments/41a25d81-2695-4312-b74a-a5f51bacc1ea" status: 202 len: 0 microversion: 2.1 time: 0.220123 Jul 30 05:02:04.255228 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 277/593] 10.222.0.20 () {58 vars in 1416 bytes} [Sat Jul 30 05:02:04 2022] DELETE /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff/os-volume_attachments/41a25d81-2695-4312-b74a-a5f51bacc1ea => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 05:02:04.263819 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-c3555f95-9142-4989-a5a1-3064f50500e3 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:02:04.266572 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-c3555f95-9142-4989-a5a1-3064f50500e3 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: f27c16ec-7d74-4a2a-9b40-c95455fa8aff] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:02:04.274230 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c3555f95-9142-4989-a5a1-3064f50500e3 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:04.275027 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c3555f95-9142-4989-a5a1-3064f50500e3 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:04.276051 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c3555f95-9142-4989-a5a1-3064f50500e3 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:04.276498 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c3555f95-9142-4989-a5a1-3064f50500e3 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:04.327688 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-c3555f95-9142-4989-a5a1-3064f50500e3 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068130 Jul 30 05:02:04.328635 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 278/594] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Jul 30 05:02:04 2022] GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 05:02:04.363045 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-f49b0bbb-84ee-449f-b25f-7c84f9afce8e tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:02:04.374617 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-f49b0bbb-84ee-449f-b25f-7c84f9afce8e tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:02:04.376127 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-f49b0bbb-84ee-449f-b25f-7c84f9afce8e tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:02:04.377515 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-f49b0bbb-84ee-449f-b25f-7c84f9afce8e tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1808 microversion: 2.20 time: 0.200429 Jul 30 05:02:04.383994 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 317/595] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:02:04 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1808 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 05:02:05.195660 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-a39a31cb-c74d-42cf-a0ba-ecfdfcb40616 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:02:05.196255 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-a39a31cb-c74d-42cf-a0ba-ecfdfcb40616 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] [instance: 267d974a-0a42-4e11-ada0-68e101c4a48f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:02:05.203337 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a39a31cb-c74d-42cf-a0ba-ecfdfcb40616 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:05.204049 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a39a31cb-c74d-42cf-a0ba-ecfdfcb40616 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:05.204819 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a39a31cb-c74d-42cf-a0ba-ecfdfcb40616 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:05.205390 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a39a31cb-c74d-42cf-a0ba-ecfdfcb40616 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:05.343581 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-c0b37c3a-9373-4f8d-95a1-3ab2c4ddca57 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:02:05.347366 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-c0b37c3a-9373-4f8d-95a1-3ab2c4ddca57 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: f27c16ec-7d74-4a2a-9b40-c95455fa8aff] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:02:05.353318 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-a39a31cb-c74d-42cf-a0ba-ecfdfcb40616 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407ad282edd74fb1adf62fb63306779c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db365a6a9f6041a7a8749fd1a1e3d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:02:05.361161 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-a39a31cb-c74d-42cf-a0ba-ecfdfcb40616 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] 10.222.0.20 "GET /compute/v2.1/servers/267d974a-0a42-4e11-ada0-68e101c4a48f" status: 200 len: 1261 microversion: 2.1 time: 0.169457 Jul 30 05:02:05.361747 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 279/596] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:02:05 2022] GET /compute/v2.1/servers/267d974a-0a42-4e11-ada0-68e101c4a48f => generated 1261 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:02:05.365882 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c0b37c3a-9373-4f8d-95a1-3ab2c4ddca57 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:05.366332 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c0b37c3a-9373-4f8d-95a1-3ab2c4ddca57 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:05.367140 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c0b37c3a-9373-4f8d-95a1-3ab2c4ddca57 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:05.367577 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c0b37c3a-9373-4f8d-95a1-3ab2c4ddca57 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:05.404833 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-31b3cee7-be13-437c-b6f6-8648b36049b3 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:02:05.405893 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-31b3cee7-be13-437c-b6f6-8648b36049b3 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:02:05.406693 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-c0b37c3a-9373-4f8d-95a1-3ab2c4ddca57 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070024 Jul 30 05:02:05.407432 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 318/597] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Jul 30 05:02:05 2022] GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 05:02:05.413449 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-31b3cee7-be13-437c-b6f6-8648b36049b3 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:05.413909 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-31b3cee7-be13-437c-b6f6-8648b36049b3 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:05.414734 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-31b3cee7-be13-437c-b6f6-8648b36049b3 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:05.415177 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-31b3cee7-be13-437c-b6f6-8648b36049b3 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:05.560348 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-31b3cee7-be13-437c-b6f6-8648b36049b3 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:02:05.572667 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-31b3cee7-be13-437c-b6f6-8648b36049b3 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:02:05.574958 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-31b3cee7-be13-437c-b6f6-8648b36049b3 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:02:05.576164 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-31b3cee7-be13-437c-b6f6-8648b36049b3 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1808 microversion: 2.20 time: 0.175997 Jul 30 05:02:05.577113 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 280/598] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:02:05 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1808 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 05:02:06.395853 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-7172209d-518f-49cf-91e6-2f3ceab1dbde tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:02:06.396659 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-7172209d-518f-49cf-91e6-2f3ceab1dbde tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] [instance: 267d974a-0a42-4e11-ada0-68e101c4a48f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:02:06.404336 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7172209d-518f-49cf-91e6-2f3ceab1dbde tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:06.405046 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7172209d-518f-49cf-91e6-2f3ceab1dbde tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:06.405842 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7172209d-518f-49cf-91e6-2f3ceab1dbde tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:06.406289 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7172209d-518f-49cf-91e6-2f3ceab1dbde tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:06.422455 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-ed2a723c-933c-44c3-a1a7-283e735750e1 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:02:06.425708 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-ed2a723c-933c-44c3-a1a7-283e735750e1 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: f27c16ec-7d74-4a2a-9b40-c95455fa8aff] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:02:06.432635 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ed2a723c-933c-44c3-a1a7-283e735750e1 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:06.433217 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ed2a723c-933c-44c3-a1a7-283e735750e1 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:06.434362 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ed2a723c-933c-44c3-a1a7-283e735750e1 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:06.434987 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ed2a723c-933c-44c3-a1a7-283e735750e1 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:06.493920 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-ed2a723c-933c-44c3-a1a7-283e735750e1 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076196 Jul 30 05:02:06.500705 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 281/599] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Jul 30 05:02:06 2022] GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 05:02:06.601845 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-1ed5772b-d99d-4937-b229-cc5f9817aae0 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:02:06.602718 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-1ed5772b-d99d-4937-b229-cc5f9817aae0 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:02:06.613514 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1ed5772b-d99d-4937-b229-cc5f9817aae0 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:06.615067 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1ed5772b-d99d-4937-b229-cc5f9817aae0 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:06.616349 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1ed5772b-d99d-4937-b229-cc5f9817aae0 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:06.616875 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1ed5772b-d99d-4937-b229-cc5f9817aae0 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:06.645477 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-7172209d-518f-49cf-91e6-2f3ceab1dbde tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407ad282edd74fb1adf62fb63306779c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db365a6a9f6041a7a8749fd1a1e3d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:02:06.658192 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-7172209d-518f-49cf-91e6-2f3ceab1dbde tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] 10.222.0.20 "GET /compute/v2.1/servers/267d974a-0a42-4e11-ada0-68e101c4a48f" status: 200 len: 1261 microversion: 2.1 time: 0.266315 Jul 30 05:02:06.658953 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 319/600] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:02:06 2022] GET /compute/v2.1/servers/267d974a-0a42-4e11-ada0-68e101c4a48f => generated 1261 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 05:02:06.787876 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-1ed5772b-d99d-4937-b229-cc5f9817aae0 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:02:06.798377 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-1ed5772b-d99d-4937-b229-cc5f9817aae0 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:02:06.801028 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-1ed5772b-d99d-4937-b229-cc5f9817aae0 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:02:06.803067 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-1ed5772b-d99d-4937-b229-cc5f9817aae0 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1808 microversion: 2.20 time: 0.205928 Jul 30 05:02:06.804204 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 282/601] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:02:06 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1808 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 05:02:07.506905 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-32b3f0b8-4216-4564-bbcc-f4ba8d3aead8 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:02:07.509684 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-32b3f0b8-4216-4564-bbcc-f4ba8d3aead8 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: f27c16ec-7d74-4a2a-9b40-c95455fa8aff] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:02:07.524256 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-32b3f0b8-4216-4564-bbcc-f4ba8d3aead8 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:07.525618 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-32b3f0b8-4216-4564-bbcc-f4ba8d3aead8 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:07.526838 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-32b3f0b8-4216-4564-bbcc-f4ba8d3aead8 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:07.528274 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-32b3f0b8-4216-4564-bbcc-f4ba8d3aead8 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:07.573286 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-32b3f0b8-4216-4564-bbcc-f4ba8d3aead8 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070573 Jul 30 05:02:07.574826 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 320/602] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Jul 30 05:02:07 2022] GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 05:02:07.680600 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-f81a56c0-d229-4520-aeec-323a5ce6e559 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:02:07.681225 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-f81a56c0-d229-4520-aeec-323a5ce6e559 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] [instance: 267d974a-0a42-4e11-ada0-68e101c4a48f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:02:07.688516 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f81a56c0-d229-4520-aeec-323a5ce6e559 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:07.689372 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f81a56c0-d229-4520-aeec-323a5ce6e559 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:07.691766 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f81a56c0-d229-4520-aeec-323a5ce6e559 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:07.692559 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f81a56c0-d229-4520-aeec-323a5ce6e559 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:07.814194 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-d855b38d-54c7-4dcb-b064-858e6d9db984 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-311852918", "imageRef": "d6a9c8e1-ecb9-4603-bb88-2b0d46ac2387", "flavorRef": "452", "networks": [{"uuid": "42292243-279e-4264-96e0-23f67ff78d87"}]}} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:02:07.857320 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-f81a56c0-d229-4520-aeec-323a5ce6e559 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407ad282edd74fb1adf62fb63306779c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db365a6a9f6041a7a8749fd1a1e3d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:02:07.866543 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-f81a56c0-d229-4520-aeec-323a5ce6e559 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] 10.222.0.20 "GET /compute/v2.1/servers/267d974a-0a42-4e11-ada0-68e101c4a48f" status: 200 len: 1261 microversion: 2.1 time: 0.189789 Jul 30 05:02:07.867616 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 283/603] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:02:07 2022] GET /compute/v2.1/servers/267d974a-0a42-4e11-ada0-68e101c4a48f => generated 1261 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:02:07.872514 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-84e93125-faed-40b5-af1f-1966491a6716 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:02:07.873321 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-84e93125-faed-40b5-af1f-1966491a6716 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:02:07.880279 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-84e93125-faed-40b5-af1f-1966491a6716 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:07.881028 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-84e93125-faed-40b5-af1f-1966491a6716 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:07.882003 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-84e93125-faed-40b5-af1f-1966491a6716 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:07.882741 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-84e93125-faed-40b5-af1f-1966491a6716 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:07.885963 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.network.neutron [None req-d855b38d-54c7-4dcb-b064-858e6d9db984 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] validate_networks() for [('42292243-279e-4264-96e0-23f67ff78d87', None, None, None, None, None)] {{(pid=117886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 05:02:08.085925 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-84e93125-faed-40b5-af1f-1966491a6716 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:02:08.095401 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-84e93125-faed-40b5-af1f-1966491a6716 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:02:08.097208 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-84e93125-faed-40b5-af1f-1966491a6716 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:02:08.099324 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-84e93125-faed-40b5-af1f-1966491a6716 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1808 microversion: 2.20 time: 0.230386 Jul 30 05:02:08.099934 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 284/604] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:02:07 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1808 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 05:02:08.361789 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-d855b38d-54c7-4dcb-b064-858e6d9db984 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Flavor limits 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 05:02:08.362181 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-d855b38d-54c7-4dcb-b064-858e6d9db984 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Image limits 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 05:02:08.363270 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-d855b38d-54c7-4dcb-b064-858e6d9db984 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Flavor pref 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 05:02:08.363693 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-d855b38d-54c7-4dcb-b064-858e6d9db984 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Image pref 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 05:02:08.364113 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-d855b38d-54c7-4dcb-b064-858e6d9db984 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 05:02:08.374389 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d855b38d-54c7-4dcb-b064-858e6d9db984 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:08.374891 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d855b38d-54c7-4dcb-b064-858e6d9db984 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:08.375675 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d855b38d-54c7-4dcb-b064-858e6d9db984 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:08.376111 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d855b38d-54c7-4dcb-b064-858e6d9db984 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:08.396649 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.quota [None req-d855b38d-54c7-4dcb-b064-858e6d9db984 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Getting quotas for project a6a02f6df4ed4365b3ce1fa970f9cf41. Resources: {'ram', 'cores', 'instances'} {{(pid=117886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 05:02:08.401086 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.quota [None req-d855b38d-54c7-4dcb-b064-858e6d9db984 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Getting quotas for user 334f2d8d9d9a4f7a90586999398f8a40 and project a6a02f6df4ed4365b3ce1fa970f9cf41. Resources: {'ram', 'cores', 'instances'} {{(pid=117886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 05:02:08.413458 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-d855b38d-54c7-4dcb-b064-858e6d9db984 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Going to run 1 instances... {{(pid=117886) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 05:02:08.415815 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-d855b38d-54c7-4dcb-b064-858e6d9db984 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] [instance: 366ac5bd-e8b9-46b5-8df3-509c48982078] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d6a9c8e1-ecb9-4603-bb88-2b0d46ac2387',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 05:02:08.464722 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-d855b38d-54c7-4dcb-b064-858e6d9db984 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.654672 Jul 30 05:02:08.471232 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 321/605] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Jul 30 05:02:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 656 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 30 05:02:08.478255 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-cc46864b-0bee-459a-b40a-75783a2e5329 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:02:08.478988 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-cc46864b-0bee-459a-b40a-75783a2e5329 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] [instance: 366ac5bd-e8b9-46b5-8df3-509c48982078] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:02:08.549454 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-cc46864b-0bee-459a-b40a-75783a2e5329 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334f2d8d9d9a4f7a90586999398f8a40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a02f6df4ed4365b3ce1fa970f9cf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:02:08.559813 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-cc46864b-0bee-459a-b40a-75783a2e5329 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] 10.222.0.20 "GET /compute/v2.1/servers/366ac5bd-e8b9-46b5-8df3-509c48982078" status: 200 len: 1218 microversion: 2.1 time: 0.085604 Jul 30 05:02:08.560733 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 285/606] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:02:08 2022] GET /compute/v2.1/servers/366ac5bd-e8b9-46b5-8df3-509c48982078 => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:02:08.587370 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-b5bceb3c-0371-42b3-81a0-f86d2d4ebafd tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:02:08.589662 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-b5bceb3c-0371-42b3-81a0-f86d2d4ebafd tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: f27c16ec-7d74-4a2a-9b40-c95455fa8aff] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:02:08.599573 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b5bceb3c-0371-42b3-81a0-f86d2d4ebafd tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:08.600161 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b5bceb3c-0371-42b3-81a0-f86d2d4ebafd tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:08.600940 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b5bceb3c-0371-42b3-81a0-f86d2d4ebafd tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:08.601554 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b5bceb3c-0371-42b3-81a0-f86d2d4ebafd tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:08.649430 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-b5bceb3c-0371-42b3-81a0-f86d2d4ebafd tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066042 Jul 30 05:02:08.654098 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 322/607] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Jul 30 05:02:08 2022] GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 05:02:08.787068 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-e5990f34-ab9d-4143-a99a-ac4dc2464dd0 req-bfd13f71-9abe-4f82-b14c-1e2e4046452f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "267d974a-0a42-4e11-ada0-68e101c4a48f", "name": "network-vif-plugged", "status": "completed", "tag": "aa5879dd-2e84-4f75-818a-bc12a63594f3"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:02:08.792846 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:02:08.804761 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-e5990f34-ab9d-4143-a99a-ac4dc2464dd0 req-bfd13f71-9abe-4f82-b14c-1e2e4046452f service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:08.805465 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-e5990f34-ab9d-4143-a99a-ac4dc2464dd0 req-bfd13f71-9abe-4f82-b14c-1e2e4046452f service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:08.822340 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-e5990f34-ab9d-4143-a99a-ac4dc2464dd0 req-bfd13f71-9abe-4f82-b14c-1e2e4046452f service nova] Creating event network-vif-plugged:aa5879dd-2e84-4f75-818a-bc12a63594f3 for instance 267d974a-0a42-4e11-ada0-68e101c4a48f on hv-cinder-85127 Jul 30 05:02:08.828920 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-e5990f34-ab9d-4143-a99a-ac4dc2464dd0 req-bfd13f71-9abe-4f82-b14c-1e2e4046452f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046388 Jul 30 05:02:08.829828 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 286/608] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Jul 30 05:02:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 05:02:08.891057 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-3f589931-750c-4da4-800c-049d7ba79f9d tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:02:08.892101 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-3f589931-750c-4da4-800c-049d7ba79f9d tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] [instance: 267d974a-0a42-4e11-ada0-68e101c4a48f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:02:08.906582 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3f589931-750c-4da4-800c-049d7ba79f9d tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:08.908405 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3f589931-750c-4da4-800c-049d7ba79f9d tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:08.909895 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3f589931-750c-4da4-800c-049d7ba79f9d tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:08.911200 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3f589931-750c-4da4-800c-049d7ba79f9d tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:09.131426 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-1ec02492-bce9-4ce0-880a-224a0b3ed63f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:02:09.132133 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-1ec02492-bce9-4ce0-880a-224a0b3ed63f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:02:09.141222 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1ec02492-bce9-4ce0-880a-224a0b3ed63f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:09.141673 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1ec02492-bce9-4ce0-880a-224a0b3ed63f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:09.142532 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1ec02492-bce9-4ce0-880a-224a0b3ed63f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:09.142977 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1ec02492-bce9-4ce0-880a-224a0b3ed63f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:09.159988 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-3f589931-750c-4da4-800c-049d7ba79f9d tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407ad282edd74fb1adf62fb63306779c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db365a6a9f6041a7a8749fd1a1e3d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:02:09.171558 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-3f589931-750c-4da4-800c-049d7ba79f9d tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] 10.222.0.20 "GET /compute/v2.1/servers/267d974a-0a42-4e11-ada0-68e101c4a48f" status: 200 len: 1261 microversion: 2.1 time: 0.287928 Jul 30 05:02:09.172139 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 323/609] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:02:08 2022] GET /compute/v2.1/servers/267d974a-0a42-4e11-ada0-68e101c4a48f => generated 1261 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:02:09.321659 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-1ec02492-bce9-4ce0-880a-224a0b3ed63f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:02:09.333135 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-1ec02492-bce9-4ce0-880a-224a0b3ed63f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:02:09.336915 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-1ec02492-bce9-4ce0-880a-224a0b3ed63f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:02:09.338290 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-1ec02492-bce9-4ce0-880a-224a0b3ed63f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1795 microversion: 2.20 time: 0.212896 Jul 30 05:02:09.339231 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 287/610] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:02:09 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1795 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 05:02:09.580679 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-aa523b0b-b92e-471a-925e-46bc338d4598 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:02:09.581616 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-aa523b0b-b92e-471a-925e-46bc338d4598 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] [instance: 366ac5bd-e8b9-46b5-8df3-509c48982078] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:02:09.588515 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-aa523b0b-b92e-471a-925e-46bc338d4598 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:09.589834 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-aa523b0b-b92e-471a-925e-46bc338d4598 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:09.590658 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-aa523b0b-b92e-471a-925e-46bc338d4598 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:09.591093 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-aa523b0b-b92e-471a-925e-46bc338d4598 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:09.663254 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-2b126e7b-4a2d-4b06-bfcd-9c622c1dcdd4 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:02:09.665702 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-2b126e7b-4a2d-4b06-bfcd-9c622c1dcdd4 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: f27c16ec-7d74-4a2a-9b40-c95455fa8aff] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:02:09.665848 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-aa523b0b-b92e-471a-925e-46bc338d4598 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334f2d8d9d9a4f7a90586999398f8a40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a02f6df4ed4365b3ce1fa970f9cf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:02:09.672579 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2b126e7b-4a2d-4b06-bfcd-9c622c1dcdd4 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:09.673044 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2b126e7b-4a2d-4b06-bfcd-9c622c1dcdd4 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:09.675547 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-aa523b0b-b92e-471a-925e-46bc338d4598 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] 10.222.0.20 "GET /compute/v2.1/servers/366ac5bd-e8b9-46b5-8df3-509c48982078" status: 200 len: 1214 microversion: 2.1 time: 0.097938 Jul 30 05:02:09.676380 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 324/611] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:02:09 2022] GET /compute/v2.1/servers/366ac5bd-e8b9-46b5-8df3-509c48982078 => generated 1214 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:02:09.678052 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2b126e7b-4a2d-4b06-bfcd-9c622c1dcdd4 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:09.679681 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2b126e7b-4a2d-4b06-bfcd-9c622c1dcdd4 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:09.712418 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-2b126e7b-4a2d-4b06-bfcd-9c622c1dcdd4 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053982 Jul 30 05:02:09.713016 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 288/612] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Jul 30 05:02:09 2022] GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 05:02:10.193112 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-415cfc67-bd5a-4085-b920-c9e0785cc5fd tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:02:10.193728 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-415cfc67-bd5a-4085-b920-c9e0785cc5fd tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] [instance: 267d974a-0a42-4e11-ada0-68e101c4a48f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:02:10.199891 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-415cfc67-bd5a-4085-b920-c9e0785cc5fd tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:10.200353 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-415cfc67-bd5a-4085-b920-c9e0785cc5fd tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:10.201092 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-415cfc67-bd5a-4085-b920-c9e0785cc5fd tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:10.201532 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-415cfc67-bd5a-4085-b920-c9e0785cc5fd tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:10.245769 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-72eb41db-d6bf-4d21-bf8b-4c4a5c26ba0a tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:02:10.248023 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-72eb41db-d6bf-4d21-bf8b-4c4a5c26ba0a tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 65b7a5ff-be03-4f45-941c-26a50cdabf02] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:02:10.255885 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-72eb41db-d6bf-4d21-bf8b-4c4a5c26ba0a tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:10.256341 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-72eb41db-d6bf-4d21-bf8b-4c4a5c26ba0a tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:10.257120 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-72eb41db-d6bf-4d21-bf8b-4c4a5c26ba0a tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:10.257564 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-72eb41db-d6bf-4d21-bf8b-4c4a5c26ba0a tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:10.280392 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.objects.instance [None req-72eb41db-d6bf-4d21-bf8b-4c4a5c26ba0a tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lazy-loading 'flavor' on Instance uuid 65b7a5ff-be03-4f45-941c-26a50cdabf02 {{(pid=117885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 05:02:10.284021 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:02:10.341939 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-415cfc67-bd5a-4085-b920-c9e0785cc5fd tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407ad282edd74fb1adf62fb63306779c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db365a6a9f6041a7a8749fd1a1e3d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:02:10.349615 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-415cfc67-bd5a-4085-b920-c9e0785cc5fd tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] 10.222.0.20 "GET /compute/v2.1/servers/267d974a-0a42-4e11-ada0-68e101c4a48f" status: 200 len: 1261 microversion: 2.1 time: 0.161192 Jul 30 05:02:10.350243 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 325/613] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:02:10 2022] GET /compute/v2.1/servers/267d974a-0a42-4e11-ada0-68e101c4a48f => generated 1261 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:02:10.414867 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-72eb41db-d6bf-4d21-bf8b-4c4a5c26ba0a tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "POST /compute/v2.1/servers/65b7a5ff-be03-4f45-941c-26a50cdabf02/action" status: 200 len: 32 microversion: 2.1 time: 0.173083 Jul 30 05:02:10.415462 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 289/614] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Jul 30 05:02:10 2022] POST /compute/v2.1/servers/65b7a5ff-be03-4f45-941c-26a50cdabf02/action => generated 32 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 30 05:02:10.425899 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-0242b590-2dc7-4eab-a315-587bc4ecf28e tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:02:10.426390 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-0242b590-2dc7-4eab-a315-587bc4ecf28e tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 65b7a5ff-be03-4f45-941c-26a50cdabf02] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:02:10.432380 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0242b590-2dc7-4eab-a315-587bc4ecf28e tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:10.432833 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0242b590-2dc7-4eab-a315-587bc4ecf28e tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:10.433605 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0242b590-2dc7-4eab-a315-587bc4ecf28e tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:10.434045 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0242b590-2dc7-4eab-a315-587bc4ecf28e tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:10.565109 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-0242b590-2dc7-4eab-a315-587bc4ecf28e tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:02:10.573631 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-0242b590-2dc7-4eab-a315-587bc4ecf28e tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/65b7a5ff-be03-4f45-941c-26a50cdabf02" status: 200 len: 1733 microversion: 2.1 time: 0.152343 Jul 30 05:02:10.574190 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 326/615] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:02:10 2022] GET /compute/v2.1/servers/65b7a5ff-be03-4f45-941c-26a50cdabf02 => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:02:10.698756 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-353ad3f4-be16-460d-82ad-7d1d827bd63f tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:02:10.699384 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-353ad3f4-be16-460d-82ad-7d1d827bd63f tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] [instance: 366ac5bd-e8b9-46b5-8df3-509c48982078] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:02:10.706250 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-353ad3f4-be16-460d-82ad-7d1d827bd63f tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:10.706827 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-353ad3f4-be16-460d-82ad-7d1d827bd63f tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:10.708353 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-353ad3f4-be16-460d-82ad-7d1d827bd63f tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:10.709158 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-353ad3f4-be16-460d-82ad-7d1d827bd63f tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:10.728328 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-20e32040-4859-403c-9ae5-02d12cbfd92c tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:02:10.732241 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-20e32040-4859-403c-9ae5-02d12cbfd92c tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: f27c16ec-7d74-4a2a-9b40-c95455fa8aff] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:02:10.741661 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-20e32040-4859-403c-9ae5-02d12cbfd92c tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:10.742647 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-20e32040-4859-403c-9ae5-02d12cbfd92c tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:10.743625 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-20e32040-4859-403c-9ae5-02d12cbfd92c tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:10.744102 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-20e32040-4859-403c-9ae5-02d12cbfd92c tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:10.765067 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=100 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:02:10.779859 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-20e32040-4859-403c-9ae5-02d12cbfd92c tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058703 Jul 30 05:02:10.780462 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 327/616] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Jul 30 05:02:10 2022] GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 05:02:10.788121 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-353ad3f4-be16-460d-82ad-7d1d827bd63f tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334f2d8d9d9a4f7a90586999398f8a40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a02f6df4ed4365b3ce1fa970f9cf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:02:10.795809 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-353ad3f4-be16-460d-82ad-7d1d827bd63f tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] 10.222.0.20 "GET /compute/v2.1/servers/366ac5bd-e8b9-46b5-8df3-509c48982078" status: 200 len: 1270 microversion: 2.1 time: 0.102107 Jul 30 05:02:10.796363 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 290/617] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:02:10 2022] GET /compute/v2.1/servers/366ac5bd-e8b9-46b5-8df3-509c48982078 => generated 1270 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:02:11.371308 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-c37ca7fe-032e-4158-bc24-954e3931e0d6 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:02:11.372077 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-c37ca7fe-032e-4158-bc24-954e3931e0d6 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] [instance: 267d974a-0a42-4e11-ada0-68e101c4a48f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:02:11.378943 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c37ca7fe-032e-4158-bc24-954e3931e0d6 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:11.380537 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c37ca7fe-032e-4158-bc24-954e3931e0d6 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:11.380712 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c37ca7fe-032e-4158-bc24-954e3931e0d6 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:11.381327 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c37ca7fe-032e-4158-bc24-954e3931e0d6 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:11.517741 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-c37ca7fe-032e-4158-bc24-954e3931e0d6 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407ad282edd74fb1adf62fb63306779c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db365a6a9f6041a7a8749fd1a1e3d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:02:11.525934 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-c37ca7fe-032e-4158-bc24-954e3931e0d6 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] 10.222.0.20 "GET /compute/v2.1/servers/267d974a-0a42-4e11-ada0-68e101c4a48f" status: 200 len: 1449 microversion: 2.1 time: 0.158534 Jul 30 05:02:11.526520 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 328/618] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:02:11 2022] GET /compute/v2.1/servers/267d974a-0a42-4e11-ada0-68e101c4a48f => generated 1449 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:02:11.547102 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-a876e5b6-7665-4605-b362-c8896555196c tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:02:11.547769 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-a876e5b6-7665-4605-b362-c8896555196c tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] [instance: 267d974a-0a42-4e11-ada0-68e101c4a48f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:02:11.554583 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a876e5b6-7665-4605-b362-c8896555196c tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:11.555035 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a876e5b6-7665-4605-b362-c8896555196c tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:11.555796 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a876e5b6-7665-4605-b362-c8896555196c tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:11.556234 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a876e5b6-7665-4605-b362-c8896555196c tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:11.595058 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-43d9fff4-62f8-4c15-aa14-14ecf680fe31 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:02:11.595677 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-43d9fff4-62f8-4c15-aa14-14ecf680fe31 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 65b7a5ff-be03-4f45-941c-26a50cdabf02] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:02:11.602253 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-43d9fff4-62f8-4c15-aa14-14ecf680fe31 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:11.602687 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-43d9fff4-62f8-4c15-aa14-14ecf680fe31 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:11.603474 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-43d9fff4-62f8-4c15-aa14-14ecf680fe31 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:11.603910 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-43d9fff4-62f8-4c15-aa14-14ecf680fe31 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:11.705420 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-a876e5b6-7665-4605-b362-c8896555196c tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407ad282edd74fb1adf62fb63306779c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db365a6a9f6041a7a8749fd1a1e3d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:02:11.714122 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-a876e5b6-7665-4605-b362-c8896555196c tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] 10.222.0.20 "GET /compute/v2.1/servers/267d974a-0a42-4e11-ada0-68e101c4a48f" status: 200 len: 1449 microversion: 2.1 time: 0.171225 Jul 30 05:02:11.714847 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 291/619] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:02:11 2022] GET /compute/v2.1/servers/267d974a-0a42-4e11-ada0-68e101c4a48f => generated 1449 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:02:11.794153 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-332fb04b-a421-450b-b5dc-d0770c08af5d tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:02:11.797390 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-332fb04b-a421-450b-b5dc-d0770c08af5d tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: f27c16ec-7d74-4a2a-9b40-c95455fa8aff] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:02:11.817325 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-332fb04b-a421-450b-b5dc-d0770c08af5d tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:11.819089 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-332fb04b-a421-450b-b5dc-d0770c08af5d tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:11.820134 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-332fb04b-a421-450b-b5dc-d0770c08af5d tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:11.820798 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-332fb04b-a421-450b-b5dc-d0770c08af5d tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:11.872487 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-43d9fff4-62f8-4c15-aa14-14ecf680fe31 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:02:11.886205 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-332fb04b-a421-450b-b5dc-d0770c08af5d tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.097718 Jul 30 05:02:11.889641 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 292/620] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Jul 30 05:02:11 2022] GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 05:02:11.893497 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-43d9fff4-62f8-4c15-aa14-14ecf680fe31 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/65b7a5ff-be03-4f45-941c-26a50cdabf02" status: 200 len: 1733 microversion: 2.1 time: 0.302061 Jul 30 05:02:11.894937 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 329/621] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:02:11 2022] GET /compute/v2.1/servers/65b7a5ff-be03-4f45-941c-26a50cdabf02 => generated 1733 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 05:02:11.897831 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-10c4aed4-c6f4-4125-bc92-b8e0f803784b tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:02:11.898534 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-10c4aed4-c6f4-4125-bc92-b8e0f803784b tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] [instance: 366ac5bd-e8b9-46b5-8df3-509c48982078] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:02:11.906602 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-10c4aed4-c6f4-4125-bc92-b8e0f803784b tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:11.907756 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-10c4aed4-c6f4-4125-bc92-b8e0f803784b tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:11.915097 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-10c4aed4-c6f4-4125-bc92-b8e0f803784b tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:11.917263 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-10c4aed4-c6f4-4125-bc92-b8e0f803784b tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:12.035447 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-10c4aed4-c6f4-4125-bc92-b8e0f803784b tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334f2d8d9d9a4f7a90586999398f8a40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a02f6df4ed4365b3ce1fa970f9cf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:02:12.043381 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-10c4aed4-c6f4-4125-bc92-b8e0f803784b tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] 10.222.0.20 "GET /compute/v2.1/servers/366ac5bd-e8b9-46b5-8df3-509c48982078" status: 200 len: 1276 microversion: 2.1 time: 0.150868 Jul 30 05:02:12.044125 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 293/622] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:02:11 2022] GET /compute/v2.1/servers/366ac5bd-e8b9-46b5-8df3-509c48982078 => generated 1276 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:02:12.901478 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-d97c4f7d-9a7c-4854-aba0-aebe9e0ee28c tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:02:12.903744 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-d97c4f7d-9a7c-4854-aba0-aebe9e0ee28c tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: f27c16ec-7d74-4a2a-9b40-c95455fa8aff] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:02:12.910924 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d97c4f7d-9a7c-4854-aba0-aebe9e0ee28c tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:12.911372 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d97c4f7d-9a7c-4854-aba0-aebe9e0ee28c tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:12.912147 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d97c4f7d-9a7c-4854-aba0-aebe9e0ee28c tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:12.912755 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d97c4f7d-9a7c-4854-aba0-aebe9e0ee28c tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:12.919921 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-e68ea2a6-8c68-4971-9db9-f7c3a3a04e50 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:02:12.921587 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-e68ea2a6-8c68-4971-9db9-f7c3a3a04e50 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 65b7a5ff-be03-4f45-941c-26a50cdabf02] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:02:12.932869 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e68ea2a6-8c68-4971-9db9-f7c3a3a04e50 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:12.933627 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e68ea2a6-8c68-4971-9db9-f7c3a3a04e50 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:12.934804 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e68ea2a6-8c68-4971-9db9-f7c3a3a04e50 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:12.935511 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e68ea2a6-8c68-4971-9db9-f7c3a3a04e50 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:12.965934 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-d97c4f7d-9a7c-4854-aba0-aebe9e0ee28c tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.067950 Jul 30 05:02:12.968040 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 330/623] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Jul 30 05:02:12 2022] GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff/os-volume_attachments => generated 25 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 30 05:02:13.042774 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-bebde9e5-ca2e-443e-8553-c8b14d3d9e4a tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:02:13.043462 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-bebde9e5-ca2e-443e-8553-c8b14d3d9e4a tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: f27c16ec-7d74-4a2a-9b40-c95455fa8aff] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:02:13.054019 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bebde9e5-ca2e-443e-8553-c8b14d3d9e4a tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:13.054966 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bebde9e5-ca2e-443e-8553-c8b14d3d9e4a tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:13.055905 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bebde9e5-ca2e-443e-8553-c8b14d3d9e4a tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:13.056354 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bebde9e5-ca2e-443e-8553-c8b14d3d9e4a tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:13.082505 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-bebde9e5-ca2e-443e-8553-c8b14d3d9e4a tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: f27c16ec-7d74-4a2a-9b40-c95455fa8aff] Going to try to terminate instance {{(pid=117886) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 05:02:13.133613 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-e68ea2a6-8c68-4971-9db9-f7c3a3a04e50 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:02:13.148628 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-e68ea2a6-8c68-4971-9db9-f7c3a3a04e50 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/65b7a5ff-be03-4f45-941c-26a50cdabf02" status: 200 len: 1733 microversion: 2.1 time: 0.233220 Jul 30 05:02:13.166150 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 294/624] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:02:12 2022] GET /compute/v2.1/servers/65b7a5ff-be03-4f45-941c-26a50cdabf02 => generated 1733 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 05:02:13.171569 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-9514ef40-c9e5-457d-8a44-7a87aa6578ba tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:02:13.173355 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-9514ef40-c9e5-457d-8a44-7a87aa6578ba tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] [instance: 366ac5bd-e8b9-46b5-8df3-509c48982078] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:02:13.179517 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:02:13.189833 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9514ef40-c9e5-457d-8a44-7a87aa6578ba tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:13.193823 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-bebde9e5-ca2e-443e-8553-c8b14d3d9e4a tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff" status: 204 len: 0 microversion: 2.1 time: 0.154438 Jul 30 05:02:13.194699 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9514ef40-c9e5-457d-8a44-7a87aa6578ba tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:13.195785 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9514ef40-c9e5-457d-8a44-7a87aa6578ba tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:13.196441 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9514ef40-c9e5-457d-8a44-7a87aa6578ba tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:13.199213 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 331/625] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Jul 30 05:02:13 2022] DELETE /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 30 05:02:13.207413 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-230e8452-c97b-4fd3-9ce4-9164a1c0a7da tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:02:13.208215 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-230e8452-c97b-4fd3-9ce4-9164a1c0a7da tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: f27c16ec-7d74-4a2a-9b40-c95455fa8aff] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:02:13.215350 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-230e8452-c97b-4fd3-9ce4-9164a1c0a7da tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:13.215807 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-230e8452-c97b-4fd3-9ce4-9164a1c0a7da tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:13.216905 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-230e8452-c97b-4fd3-9ce4-9164a1c0a7da tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:13.217351 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-230e8452-c97b-4fd3-9ce4-9164a1c0a7da tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:13.434817 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-9514ef40-c9e5-457d-8a44-7a87aa6578ba tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334f2d8d9d9a4f7a90586999398f8a40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a02f6df4ed4365b3ce1fa970f9cf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:02:13.443840 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-9514ef40-c9e5-457d-8a44-7a87aa6578ba tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] 10.222.0.20 "GET /compute/v2.1/servers/366ac5bd-e8b9-46b5-8df3-509c48982078" status: 200 len: 1318 microversion: 2.1 time: 0.288040 Jul 30 05:02:13.444734 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 295/626] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:02:13 2022] GET /compute/v2.1/servers/366ac5bd-e8b9-46b5-8df3-509c48982078 => generated 1318 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:02:13.544138 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-3b22cab5-efab-4cb1-b661-5cc49747b460 req-6e537aad-2926-493b-9f98-a503e22ae3b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "366ac5bd-e8b9-46b5-8df3-509c48982078", "tag": "a0185df1-915f-4d83-8e9a-39b3098f5156"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:02:13.555079 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-3b22cab5-efab-4cb1-b661-5cc49747b460 req-6e537aad-2926-493b-9f98-a503e22ae3b2 service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:13.555830 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-3b22cab5-efab-4cb1-b661-5cc49747b460 req-6e537aad-2926-493b-9f98-a503e22ae3b2 service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:13.568171 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-3b22cab5-efab-4cb1-b661-5cc49747b460 req-6e537aad-2926-493b-9f98-a503e22ae3b2 service nova] Creating event network-changed:a0185df1-915f-4d83-8e9a-39b3098f5156 for instance 366ac5bd-e8b9-46b5-8df3-509c48982078 on hv-cinder-85127 Jul 30 05:02:13.573844 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-3b22cab5-efab-4cb1-b661-5cc49747b460 req-6e537aad-2926-493b-9f98-a503e22ae3b2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033635 Jul 30 05:02:13.574479 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 296/627] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Jul 30 05:02:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 05:02:13.803296 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-230e8452-c97b-4fd3-9ce4-9164a1c0a7da tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8abb58f9c274e568d2d0fe3d4df11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01500cb03c74d1082090cd1c1836169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:02:13.823051 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-230e8452-c97b-4fd3-9ce4-9164a1c0a7da tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff" status: 200 len: 1680 microversion: 2.1 time: 0.616398 Jul 30 05:02:13.823711 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 332/628] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:02:13 2022] GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff => generated 1680 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:02:14.175398 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-ffd29153-c45b-474a-b34a-9708ccfb8765 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:02:14.176109 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-ffd29153-c45b-474a-b34a-9708ccfb8765 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 65b7a5ff-be03-4f45-941c-26a50cdabf02] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:02:14.182744 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ffd29153-c45b-474a-b34a-9708ccfb8765 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:14.183201 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ffd29153-c45b-474a-b34a-9708ccfb8765 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:14.184161 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ffd29153-c45b-474a-b34a-9708ccfb8765 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:14.184605 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ffd29153-c45b-474a-b34a-9708ccfb8765 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:14.338978 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-ffd29153-c45b-474a-b34a-9708ccfb8765 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:02:14.349439 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-ffd29153-c45b-474a-b34a-9708ccfb8765 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/65b7a5ff-be03-4f45-941c-26a50cdabf02" status: 200 len: 1733 microversion: 2.1 time: 0.179478 Jul 30 05:02:14.350028 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 297/629] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:02:14 2022] GET /compute/v2.1/servers/65b7a5ff-be03-4f45-941c-26a50cdabf02 => generated 1733 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:02:14.470126 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-3c44b3a2-dc0a-4765-be7d-a4c707bd3830 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:02:14.474598 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-3c44b3a2-dc0a-4765-be7d-a4c707bd3830 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] [instance: 366ac5bd-e8b9-46b5-8df3-509c48982078] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:02:14.482321 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3c44b3a2-dc0a-4765-be7d-a4c707bd3830 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:14.483106 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3c44b3a2-dc0a-4765-be7d-a4c707bd3830 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:14.484990 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3c44b3a2-dc0a-4765-be7d-a4c707bd3830 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:14.485939 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3c44b3a2-dc0a-4765-be7d-a4c707bd3830 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:14.522709 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-1ecbb862-d338-4980-a198-51e3e2bac3a2 req-f2dae0fd-202c-4e51-bfc4-3c582d1b9b18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "267d974a-0a42-4e11-ada0-68e101c4a48f", "tag": "aa5879dd-2e84-4f75-818a-bc12a63594f3"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:02:14.541152 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-1ecbb862-d338-4980-a198-51e3e2bac3a2 req-f2dae0fd-202c-4e51-bfc4-3c582d1b9b18 service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:14.542261 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-1ecbb862-d338-4980-a198-51e3e2bac3a2 req-f2dae0fd-202c-4e51-bfc4-3c582d1b9b18 service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:14.555635 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-1ecbb862-d338-4980-a198-51e3e2bac3a2 req-f2dae0fd-202c-4e51-bfc4-3c582d1b9b18 service nova] Creating event network-changed:aa5879dd-2e84-4f75-818a-bc12a63594f3 for instance 267d974a-0a42-4e11-ada0-68e101c4a48f on hv-cinder-85127 Jul 30 05:02:14.560803 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-1ecbb862-d338-4980-a198-51e3e2bac3a2 req-f2dae0fd-202c-4e51-bfc4-3c582d1b9b18 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041821 Jul 30 05:02:14.561971 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 298/630] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Jul 30 05:02:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 05:02:14.702840 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-3c44b3a2-dc0a-4765-be7d-a4c707bd3830 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334f2d8d9d9a4f7a90586999398f8a40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a02f6df4ed4365b3ce1fa970f9cf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:02:14.716867 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-3c44b3a2-dc0a-4765-be7d-a4c707bd3830 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] 10.222.0.20 "GET /compute/v2.1/servers/366ac5bd-e8b9-46b5-8df3-509c48982078" status: 200 len: 1318 microversion: 2.1 time: 0.251916 Jul 30 05:02:14.717669 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 333/631] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:02:14 2022] GET /compute/v2.1/servers/366ac5bd-e8b9-46b5-8df3-509c48982078 => generated 1318 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:02:14.846283 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-020863fa-4657-4db0-96ef-caa3c93e3c5e tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:02:14.847325 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-020863fa-4657-4db0-96ef-caa3c93e3c5e tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: f27c16ec-7d74-4a2a-9b40-c95455fa8aff] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:02:14.858871 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-020863fa-4657-4db0-96ef-caa3c93e3c5e tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:14.859682 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-020863fa-4657-4db0-96ef-caa3c93e3c5e tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:14.863502 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-020863fa-4657-4db0-96ef-caa3c93e3c5e tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:14.864345 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-020863fa-4657-4db0-96ef-caa3c93e3c5e tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:15.235794 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-020863fa-4657-4db0-96ef-caa3c93e3c5e tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8abb58f9c274e568d2d0fe3d4df11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01500cb03c74d1082090cd1c1836169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:02:15.246786 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-020863fa-4657-4db0-96ef-caa3c93e3c5e tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff" status: 200 len: 1680 microversion: 2.1 time: 0.405181 Jul 30 05:02:15.247372 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 299/632] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:02:14 2022] GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff => generated 1680 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:02:15.371660 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-20c5c900-2587-4c3f-8b35-9cd4bd8f3dc3 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:02:15.372280 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-20c5c900-2587-4c3f-8b35-9cd4bd8f3dc3 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 65b7a5ff-be03-4f45-941c-26a50cdabf02] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:02:15.383775 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-20c5c900-2587-4c3f-8b35-9cd4bd8f3dc3 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:15.387951 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-20c5c900-2587-4c3f-8b35-9cd4bd8f3dc3 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:15.389064 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-20c5c900-2587-4c3f-8b35-9cd4bd8f3dc3 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:15.391003 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-20c5c900-2587-4c3f-8b35-9cd4bd8f3dc3 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:15.738615 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-1e5b6966-e775-4c74-9508-0972f0102701 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:02:15.739248 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-1e5b6966-e775-4c74-9508-0972f0102701 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] [instance: 366ac5bd-e8b9-46b5-8df3-509c48982078] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:02:15.746011 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1e5b6966-e775-4c74-9508-0972f0102701 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:15.752350 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1e5b6966-e775-4c74-9508-0972f0102701 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:15.753647 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1e5b6966-e775-4c74-9508-0972f0102701 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:15.754308 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1e5b6966-e775-4c74-9508-0972f0102701 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:15.754728 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-20c5c900-2587-4c3f-8b35-9cd4bd8f3dc3 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:02:15.765901 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-20c5c900-2587-4c3f-8b35-9cd4bd8f3dc3 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/65b7a5ff-be03-4f45-941c-26a50cdabf02" status: 200 len: 1733 microversion: 2.1 time: 0.397926 Jul 30 05:02:15.766769 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 334/633] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:02:15 2022] GET /compute/v2.1/servers/65b7a5ff-be03-4f45-941c-26a50cdabf02 => generated 1733 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 05:02:16.104370 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-1e5b6966-e775-4c74-9508-0972f0102701 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334f2d8d9d9a4f7a90586999398f8a40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a02f6df4ed4365b3ce1fa970f9cf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:02:16.111843 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-1e5b6966-e775-4c74-9508-0972f0102701 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] 10.222.0.20 "GET /compute/v2.1/servers/366ac5bd-e8b9-46b5-8df3-509c48982078" status: 200 len: 1318 microversion: 2.1 time: 0.377381 Jul 30 05:02:16.113249 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 300/634] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:02:15 2022] GET /compute/v2.1/servers/366ac5bd-e8b9-46b5-8df3-509c48982078 => generated 1318 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 05:02:16.269688 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-dd6d3c16-831c-46c4-98a8-1a52be34c084 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:02:16.270204 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-dd6d3c16-831c-46c4-98a8-1a52be34c084 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: f27c16ec-7d74-4a2a-9b40-c95455fa8aff] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:02:16.276304 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-dd6d3c16-831c-46c4-98a8-1a52be34c084 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:16.276763 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-dd6d3c16-831c-46c4-98a8-1a52be34c084 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:16.277532 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-dd6d3c16-831c-46c4-98a8-1a52be34c084 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:16.277969 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-dd6d3c16-831c-46c4-98a8-1a52be34c084 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:16.350388 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-dd6d3c16-831c-46c4-98a8-1a52be34c084 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8abb58f9c274e568d2d0fe3d4df11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01500cb03c74d1082090cd1c1836169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:02:16.360604 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-dd6d3c16-831c-46c4-98a8-1a52be34c084 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff" status: 200 len: 1613 microversion: 2.1 time: 0.095536 Jul 30 05:02:16.361180 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 335/635] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:02:16 2022] GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff => generated 1613 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:02:16.604029 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-b85d952a-90c5-4fd3-8e2c-5e3bc27fef5c req-6047356c-9c92-462d-b4dd-19fa26356edf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f27c16ec-7d74-4a2a-9b40-c95455fa8aff", "name": "network-vif-deleted", "tag": "17ee318c-931e-496a-b49d-170e9dd9ad2b"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:02:16.613885 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-b85d952a-90c5-4fd3-8e2c-5e3bc27fef5c req-6047356c-9c92-462d-b4dd-19fa26356edf service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:16.614335 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-b85d952a-90c5-4fd3-8e2c-5e3bc27fef5c req-6047356c-9c92-462d-b4dd-19fa26356edf service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:16.625725 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-b85d952a-90c5-4fd3-8e2c-5e3bc27fef5c req-6047356c-9c92-462d-b4dd-19fa26356edf service nova] Creating event network-vif-deleted:17ee318c-931e-496a-b49d-170e9dd9ad2b for instance f27c16ec-7d74-4a2a-9b40-c95455fa8aff on hv-cinder-85127 Jul 30 05:02:16.631261 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-b85d952a-90c5-4fd3-8e2c-5e3bc27fef5c req-6047356c-9c92-462d-b4dd-19fa26356edf service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030981 Jul 30 05:02:16.631858 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 301/636] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Jul 30 05:02:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 05:02:16.789506 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-542238fb-0bea-4e7b-a83b-178eed6518f9 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:02:16.791112 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-542238fb-0bea-4e7b-a83b-178eed6518f9 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 65b7a5ff-be03-4f45-941c-26a50cdabf02] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:02:16.817380 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-542238fb-0bea-4e7b-a83b-178eed6518f9 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:16.817380 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-542238fb-0bea-4e7b-a83b-178eed6518f9 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:16.817380 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-542238fb-0bea-4e7b-a83b-178eed6518f9 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:16.817380 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-542238fb-0bea-4e7b-a83b-178eed6518f9 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:17.010037 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-542238fb-0bea-4e7b-a83b-178eed6518f9 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:02:17.018904 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-542238fb-0bea-4e7b-a83b-178eed6518f9 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/65b7a5ff-be03-4f45-941c-26a50cdabf02" status: 200 len: 1733 microversion: 2.1 time: 0.234678 Jul 30 05:02:17.019775 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 336/637] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:02:16 2022] GET /compute/v2.1/servers/65b7a5ff-be03-4f45-941c-26a50cdabf02 => generated 1733 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 05:02:17.134650 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-9ecf03c0-164f-43a2-b893-130a7d921748 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:02:17.135367 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-9ecf03c0-164f-43a2-b893-130a7d921748 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] [instance: 366ac5bd-e8b9-46b5-8df3-509c48982078] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:02:17.142569 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9ecf03c0-164f-43a2-b893-130a7d921748 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:17.143270 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9ecf03c0-164f-43a2-b893-130a7d921748 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:17.144322 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9ecf03c0-164f-43a2-b893-130a7d921748 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:17.145006 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9ecf03c0-164f-43a2-b893-130a7d921748 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:17.297858 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-9ecf03c0-164f-43a2-b893-130a7d921748 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334f2d8d9d9a4f7a90586999398f8a40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a02f6df4ed4365b3ce1fa970f9cf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:02:17.306940 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-9ecf03c0-164f-43a2-b893-130a7d921748 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] 10.222.0.20 "GET /compute/v2.1/servers/366ac5bd-e8b9-46b5-8df3-509c48982078" status: 200 len: 1318 microversion: 2.1 time: 0.176452 Jul 30 05:02:17.314801 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 302/638] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:02:17 2022] GET /compute/v2.1/servers/366ac5bd-e8b9-46b5-8df3-509c48982078 => generated 1318 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:02:17.383190 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-afc58877-015f-42a2-96c3-138700beed63 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:02:17.383845 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-afc58877-015f-42a2-96c3-138700beed63 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: f27c16ec-7d74-4a2a-9b40-c95455fa8aff] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:02:17.390646 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-afc58877-015f-42a2-96c3-138700beed63 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:17.391197 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-afc58877-015f-42a2-96c3-138700beed63 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:17.391990 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-afc58877-015f-42a2-96c3-138700beed63 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:17.392434 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-afc58877-015f-42a2-96c3-138700beed63 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:17.408004 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.wsgi [None req-afc58877-015f-42a2-96c3-138700beed63 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] HTTP exception thrown: Instance f27c16ec-7d74-4a2a-9b40-c95455fa8aff could not be found. Jul 30 05:02:17.410390 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-afc58877-015f-42a2-96c3-138700beed63 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Request method failure captured: Jul 30 05:02:17.410390 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: request: GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff HTTP/1.1 Jul 30 05:02:17.410390 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Accept: application/json Jul 30 05:02:17.410390 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Accept-Encoding: identity Jul 30 05:02:17.410390 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Connection: close Jul 30 05:02:17.410390 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Content-Length: 0 Jul 30 05:02:17.410390 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Content-Type: application/json Jul 30 05:02:17.410390 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Host: 10.222.0.20 Jul 30 05:02:17.410390 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Openstack-System-Scope: None Jul 30 05:02:17.410390 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: User-Agent: python-urllib3/1.26.10 Jul 30 05:02:17.410390 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Auth-Token: gAAAAABi5LpsOyvntIvMWRkdgHAWaqLWWQheVZGRSyU7m8d_2qr8zQQH3DOakkgVq23Q75nTB9odGI0F-DQpTcNmJESi7-iRiz2-Pz62AvInyIstK7nwhx7nj-QdimoRc10ZS0jEzNztVniYwiMWef1RbG0o7cJ-tzIv7p3eOvqZTnGZgHQkQhc Jul 30 05:02:17.410390 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Domain-Id: None Jul 30 05:02:17.410390 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Domain-Name: None Jul 30 05:02:17.410390 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Identity-Status: Confirmed Jul 30 05:02:17.410390 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Is-Admin-Project: True Jul 30 05:02:17.410390 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Project-Domain-Id: default Jul 30 05:02:17.410390 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Project-Domain-Name: Default Jul 30 05:02:17.410390 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Project-Id: e01500cb03c74d1082090cd1c1836169 Jul 30 05:02:17.410390 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Project-Name: tempest-AttachVolumeNegativeTest-490621097 Jul 30 05:02:17.410390 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Role: member,reader Jul 30 05:02:17.410390 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Roles: member,reader Jul 30 05:02:17.412031 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e01500cb03c74d1082090cd1c1836169"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e01500cb03c74d1082090cd1c1836169"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e01500cb03c74d1082090cd1c1836169"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e01500cb03c74d1082090cd1c1836169"}]}] Jul 30 05:02:17.412031 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Tenant: tempest-AttachVolumeNegativeTest-490621097 Jul 30 05:02:17.412031 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Tenant-Id: e01500cb03c74d1082090cd1c1836169 Jul 30 05:02:17.412031 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-490621097 Jul 30 05:02:17.412031 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User: tempest-AttachVolumeNegativeTest-490621097-project Jul 30 05:02:17.412031 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User-Domain-Id: default Jul 30 05:02:17.412031 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User-Domain-Name: Default Jul 30 05:02:17.412031 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User-Id: a8abb58f9c274e568d2d0fe3d4df11de Jul 30 05:02:17.412031 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User-Name: tempest-AttachVolumeNegativeTest-490621097-project Jul 30 05:02:17.412031 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: method: > Jul 30 05:02:17.412031 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: exception: Instance f27c16ec-7d74-4a2a-9b40-c95455fa8aff could not be found. Jul 30 05:02:17.412031 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: action_args: {'id': 'f27c16ec-7d74-4a2a-9b40-c95455fa8aff'} Jul 30 05:02:17.412949 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 05:02:17.412949 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:02:17.412949 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 05:02:17.412949 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 05:02:17.412949 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 05:02:17.412949 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 05:02:17.412949 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 05:02:17.412949 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 05:02:17.412949 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 05:02:17.412949 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 05:02:17.412949 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f27c16ec-7d74-4a2a-9b40-c95455fa8aff could not be found. Jul 30 05:02:17.412949 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 05:02:17.412949 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 05:02:17.412949 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 05:02:17.412949 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:02:17.412949 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 05:02:17.412949 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 05:02:17.412949 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 05:02:17.412949 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 05:02:17.412949 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 05:02:17.414390 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 05:02:17.414390 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 05:02:17.414390 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 05:02:17.414390 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 05:02:17.414390 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 05:02:17.414390 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 05:02:17.414390 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 05:02:17.414390 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f27c16ec-7d74-4a2a-9b40-c95455fa8aff could not be found. Jul 30 05:02:17.414390 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 05:02:17.414390 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 05:02:17.414390 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 05:02:17.414390 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:02:17.414390 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 05:02:17.414390 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 05:02:17.414390 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 05:02:17.414390 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 05:02:17.414390 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f27c16ec-7d74-4a2a-9b40-c95455fa8aff could not be found. Jul 30 05:02:17.414390 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 05:02:17.416296 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-afc58877-015f-42a2-96c3-138700beed63 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Returning 404 to user: Instance f27c16ec-7d74-4a2a-9b40-c95455fa8aff could not be found. {{(pid=117886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 05:02:17.416296 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-afc58877-015f-42a2-96c3-138700beed63 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff" status: 404 len: 111 microversion: 2.1 time: 0.032555 Jul 30 05:02:17.416296 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 337/639] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:02:17 2022] GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 30 05:02:17.423219 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-799477c4-4c22-4820-8f71-071832a86c64 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '.version_select at 0x7f2db40a7e50>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:02:17.443874 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-799477c4-4c22-4820-8f71-071832a86c64 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2105500540" status: 202 len: 0 microversion: 2.1 time: 0.024627 Jul 30 05:02:17.444516 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 303/640] 10.222.0.20 () {58 vars in 1221 bytes} [Sat Jul 30 05:02:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2105500540 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 05:02:18.044089 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-9580947d-60fb-4684-84b0-9bed35f5624a tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:02:18.044708 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-9580947d-60fb-4684-84b0-9bed35f5624a tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 65b7a5ff-be03-4f45-941c-26a50cdabf02] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:02:18.051867 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9580947d-60fb-4684-84b0-9bed35f5624a tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:18.052318 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9580947d-60fb-4684-84b0-9bed35f5624a tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:18.053090 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9580947d-60fb-4684-84b0-9bed35f5624a tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:18.053521 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9580947d-60fb-4684-84b0-9bed35f5624a tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:18.106214 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-bcd77177-384a-4935-9d9d-e8b59c758a56 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Action: 'create', calling method: .version_select at 0x7f2db4182550>, body: {"keypair": {"name": "tempest-keypair-887792003", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAxCm1rhmIv0ctpDZ4Gbe7om5jy2IlrZ8/XjAmil3F933bowy5DEUcKZlGnT8pck7JxBHQWO5RDikJJHzLLISlUeqicZE4dF0hY2EwhqX7vl78EMx2trMesFrwUuxDHhHQ=="}} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:02:18.124330 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.quota [None req-bcd77177-384a-4935-9d9d-e8b59c758a56 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Getting quotas for project e01500cb03c74d1082090cd1c1836169. Resources: {'key_pairs'} {{(pid=117885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 05:02:18.128938 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.quota [None req-bcd77177-384a-4935-9d9d-e8b59c758a56 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Getting quotas for user a8abb58f9c274e568d2d0fe3d4df11de and project e01500cb03c74d1082090cd1c1836169. Resources: {'key_pairs'} {{(pid=117885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 05:02:18.151884 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-bcd77177-384a-4935-9d9d-e8b59c758a56 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.049538 Jul 30 05:02:18.152494 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 304/641] 10.222.0.20 () {60 vars in 1159 bytes} [Sat Jul 30 05:02:18 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 05:02:18.191732 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-9580947d-60fb-4684-84b0-9bed35f5624a tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:02:18.199809 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-9580947d-60fb-4684-84b0-9bed35f5624a tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/65b7a5ff-be03-4f45-941c-26a50cdabf02" status: 200 len: 1733 microversion: 2.1 time: 0.159510 Jul 30 05:02:18.200454 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 338/642] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:02:18 2022] GET /compute/v2.1/servers/65b7a5ff-be03-4f45-941c-26a50cdabf02 => generated 1733 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:02:18.328564 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-d26c7569-e922-4f09-a399-86694a742bcb tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:02:18.329200 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-d26c7569-e922-4f09-a399-86694a742bcb tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] [instance: 366ac5bd-e8b9-46b5-8df3-509c48982078] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:02:18.338767 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d26c7569-e922-4f09-a399-86694a742bcb tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:18.339525 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d26c7569-e922-4f09-a399-86694a742bcb tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:18.340548 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d26c7569-e922-4f09-a399-86694a742bcb tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:18.341212 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d26c7569-e922-4f09-a399-86694a742bcb tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:18.503583 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-d26c7569-e922-4f09-a399-86694a742bcb tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334f2d8d9d9a4f7a90586999398f8a40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a02f6df4ed4365b3ce1fa970f9cf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:02:18.524793 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-d26c7569-e922-4f09-a399-86694a742bcb tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] 10.222.0.20 "GET /compute/v2.1/servers/366ac5bd-e8b9-46b5-8df3-509c48982078" status: 200 len: 1318 microversion: 2.1 time: 0.200395 Jul 30 05:02:18.526329 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 305/643] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:02:18 2022] GET /compute/v2.1/servers/366ac5bd-e8b9-46b5-8df3-509c48982078 => generated 1318 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:02:19.223416 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-3c83dc2a-7856-4331-b0e0-d632aca2c943 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:02:19.224093 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-3c83dc2a-7856-4331-b0e0-d632aca2c943 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 65b7a5ff-be03-4f45-941c-26a50cdabf02] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:02:19.227171 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell0:SELECT=2 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:02:19.228455 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell0:SELECT=6 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:02:19.233759 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3c83dc2a-7856-4331-b0e0-d632aca2c943 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:19.234476 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3c83dc2a-7856-4331-b0e0-d632aca2c943 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:19.235630 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3c83dc2a-7856-4331-b0e0-d632aca2c943 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:19.236260 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3c83dc2a-7856-4331-b0e0-d632aca2c943 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:19.467097 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-3c83dc2a-7856-4331-b0e0-d632aca2c943 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:02:19.477561 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-3c83dc2a-7856-4331-b0e0-d632aca2c943 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/65b7a5ff-be03-4f45-941c-26a50cdabf02" status: 200 len: 1733 microversion: 2.1 time: 0.259645 Jul 30 05:02:19.478286 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 339/644] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:02:19 2022] GET /compute/v2.1/servers/65b7a5ff-be03-4f45-941c-26a50cdabf02 => generated 1733 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:02:19.546505 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-60eb0242-0b9f-4a7d-99bd-6324ba5afb69 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:02:19.547185 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-60eb0242-0b9f-4a7d-99bd-6324ba5afb69 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] [instance: 366ac5bd-e8b9-46b5-8df3-509c48982078] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:02:19.554010 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-60eb0242-0b9f-4a7d-99bd-6324ba5afb69 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:19.554491 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-60eb0242-0b9f-4a7d-99bd-6324ba5afb69 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:19.555403 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-60eb0242-0b9f-4a7d-99bd-6324ba5afb69 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:19.556350 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-60eb0242-0b9f-4a7d-99bd-6324ba5afb69 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:19.679714 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-91e39cec-9cd5-436d-b484-d2fabaf02365 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-147770679", "imageRef": "d6a9c8e1-ecb9-4603-bb88-2b0d46ac2387", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "afd82f39-2725-4de8-bc03-d4d225abc92e"}], "security_groups": [{"name": "tempest-securitygroup--1358989646"}], "key_name": "tempest-keypair-887792003", "user_data": "}} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:02:19.766575 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-60eb0242-0b9f-4a7d-99bd-6324ba5afb69 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334f2d8d9d9a4f7a90586999398f8a40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a02f6df4ed4365b3ce1fa970f9cf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:02:19.775261 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-60eb0242-0b9f-4a7d-99bd-6324ba5afb69 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] 10.222.0.20 "GET /compute/v2.1/servers/366ac5bd-e8b9-46b5-8df3-509c48982078" status: 200 len: 1318 microversion: 2.1 time: 0.233139 Jul 30 05:02:19.775996 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 306/645] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:02:19 2022] GET /compute/v2.1/servers/366ac5bd-e8b9-46b5-8df3-509c48982078 => generated 1318 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:02:19.791329 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.network.neutron [None req-91e39cec-9cd5-436d-b484-d2fabaf02365 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] validate_networks() for [('afd82f39-2725-4de8-bc03-d4d225abc92e', None, None, None, None, None)] {{(pid=117886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 05:02:20.173785 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-91e39cec-9cd5-436d-b484-d2fabaf02365 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Flavor limits 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 05:02:20.174215 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-91e39cec-9cd5-436d-b484-d2fabaf02365 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Image limits 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 05:02:20.175267 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-91e39cec-9cd5-436d-b484-d2fabaf02365 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Flavor pref 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 05:02:20.175912 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-91e39cec-9cd5-436d-b484-d2fabaf02365 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Image pref 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 05:02:20.176535 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-91e39cec-9cd5-436d-b484-d2fabaf02365 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 05:02:20.186981 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-91e39cec-9cd5-436d-b484-d2fabaf02365 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:20.187457 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-91e39cec-9cd5-436d-b484-d2fabaf02365 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:20.188266 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-91e39cec-9cd5-436d-b484-d2fabaf02365 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:20.188711 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-91e39cec-9cd5-436d-b484-d2fabaf02365 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:20.210787 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.quota [None req-91e39cec-9cd5-436d-b484-d2fabaf02365 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Getting quotas for project e01500cb03c74d1082090cd1c1836169. Resources: {'ram', 'cores', 'instances'} {{(pid=117886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 05:02:20.215437 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.quota [None req-91e39cec-9cd5-436d-b484-d2fabaf02365 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Getting quotas for user a8abb58f9c274e568d2d0fe3d4df11de and project e01500cb03c74d1082090cd1c1836169. Resources: {'ram', 'cores', 'instances'} {{(pid=117886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 05:02:20.226791 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-91e39cec-9cd5-436d-b484-d2fabaf02365 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Going to run 1 instances... {{(pid=117886) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 05:02:20.229067 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-91e39cec-9cd5-436d-b484-d2fabaf02365 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: 0a2aa4b1-2fd2-45e4-a058-71f0855e48c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d6a9c8e1-ecb9-4603-bb88-2b0d46ac2387',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 05:02:20.279378 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-91e39cec-9cd5-436d-b484-d2fabaf02365 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.604417 Jul 30 05:02:20.285801 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 340/646] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Jul 30 05:02:19 2022] POST /compute/v2.1/servers => generated 402 bytes in 606 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 30 05:02:20.291048 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-bd24cec3-5668-4394-b541-1355071f10b2 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:02:20.291678 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-bd24cec3-5668-4394-b541-1355071f10b2 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: 0a2aa4b1-2fd2-45e4-a058-71f0855e48c0] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:02:20.353602 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-bd24cec3-5668-4394-b541-1355071f10b2 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8abb58f9c274e568d2d0fe3d4df11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01500cb03c74d1082090cd1c1836169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:02:20.362061 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-bd24cec3-5668-4394-b541-1355071f10b2 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/0a2aa4b1-2fd2-45e4-a058-71f0855e48c0" status: 200 len: 1240 microversion: 2.1 time: 0.074681 Jul 30 05:02:20.364151 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 307/647] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:02:20 2022] GET /compute/v2.1/servers/0a2aa4b1-2fd2-45e4-a058-71f0855e48c0 => generated 1240 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:02:20.502859 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-64816f27-a165-48d5-9d46-08c842f7cba7 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:02:20.504172 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-64816f27-a165-48d5-9d46-08c842f7cba7 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 65b7a5ff-be03-4f45-941c-26a50cdabf02] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:02:20.515114 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-64816f27-a165-48d5-9d46-08c842f7cba7 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:20.516124 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-64816f27-a165-48d5-9d46-08c842f7cba7 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:20.517051 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-64816f27-a165-48d5-9d46-08c842f7cba7 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:20.517590 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-64816f27-a165-48d5-9d46-08c842f7cba7 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:20.694066 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-64816f27-a165-48d5-9d46-08c842f7cba7 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:02:20.703115 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-64816f27-a165-48d5-9d46-08c842f7cba7 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/65b7a5ff-be03-4f45-941c-26a50cdabf02" status: 200 len: 1733 microversion: 2.1 time: 0.205792 Jul 30 05:02:20.703685 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 341/648] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:02:20 2022] GET /compute/v2.1/servers/65b7a5ff-be03-4f45-941c-26a50cdabf02 => generated 1733 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:02:20.762035 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-6b56a652-2138-4342-9ae9-b155dff67619 req-02b4c3fa-1622-4ca5-bea4-df021daa2587 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "366ac5bd-e8b9-46b5-8df3-509c48982078", "name": "network-vif-plugged", "status": "completed", "tag": "a0185df1-915f-4d83-8e9a-39b3098f5156"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:02:20.775434 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-6b56a652-2138-4342-9ae9-b155dff67619 req-02b4c3fa-1622-4ca5-bea4-df021daa2587 service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:20.776086 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-6b56a652-2138-4342-9ae9-b155dff67619 req-02b4c3fa-1622-4ca5-bea4-df021daa2587 service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:20.790701 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-6b56a652-2138-4342-9ae9-b155dff67619 req-02b4c3fa-1622-4ca5-bea4-df021daa2587 service nova] Creating event network-vif-plugged:a0185df1-915f-4d83-8e9a-39b3098f5156 for instance 366ac5bd-e8b9-46b5-8df3-509c48982078 on hv-cinder-85127 Jul 30 05:02:20.797315 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-6b56a652-2138-4342-9ae9-b155dff67619 req-02b4c3fa-1622-4ca5-bea4-df021daa2587 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039173 Jul 30 05:02:20.798363 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-663b6fd8-e3ae-43aa-a15b-68ad1abeda90 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:02:20.799034 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-663b6fd8-e3ae-43aa-a15b-68ad1abeda90 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] [instance: 366ac5bd-e8b9-46b5-8df3-509c48982078] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:02:20.799266 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 308/649] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Jul 30 05:02:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 05:02:20.813795 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-663b6fd8-e3ae-43aa-a15b-68ad1abeda90 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:20.814374 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-663b6fd8-e3ae-43aa-a15b-68ad1abeda90 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:20.815346 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-663b6fd8-e3ae-43aa-a15b-68ad1abeda90 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:20.816164 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-663b6fd8-e3ae-43aa-a15b-68ad1abeda90 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:21.022900 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-663b6fd8-e3ae-43aa-a15b-68ad1abeda90 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334f2d8d9d9a4f7a90586999398f8a40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a02f6df4ed4365b3ce1fa970f9cf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:02:21.032336 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-663b6fd8-e3ae-43aa-a15b-68ad1abeda90 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] 10.222.0.20 "GET /compute/v2.1/servers/366ac5bd-e8b9-46b5-8df3-509c48982078" status: 200 len: 1318 microversion: 2.1 time: 0.238734 Jul 30 05:02:21.033538 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 342/650] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:02:20 2022] GET /compute/v2.1/servers/366ac5bd-e8b9-46b5-8df3-509c48982078 => generated 1318 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:02:21.384288 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-807427f4-bcd6-45c7-99ad-42433bc10b23 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:02:21.385023 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-807427f4-bcd6-45c7-99ad-42433bc10b23 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: 0a2aa4b1-2fd2-45e4-a058-71f0855e48c0] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:02:21.391246 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-807427f4-bcd6-45c7-99ad-42433bc10b23 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:21.391748 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-807427f4-bcd6-45c7-99ad-42433bc10b23 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:21.392516 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-807427f4-bcd6-45c7-99ad-42433bc10b23 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:21.392957 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-807427f4-bcd6-45c7-99ad-42433bc10b23 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:21.461211 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-807427f4-bcd6-45c7-99ad-42433bc10b23 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8abb58f9c274e568d2d0fe3d4df11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01500cb03c74d1082090cd1c1836169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:02:21.468945 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-807427f4-bcd6-45c7-99ad-42433bc10b23 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/0a2aa4b1-2fd2-45e4-a058-71f0855e48c0" status: 200 len: 1292 microversion: 2.1 time: 0.088676 Jul 30 05:02:21.469537 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 309/651] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:02:21 2022] GET /compute/v2.1/servers/0a2aa4b1-2fd2-45e4-a058-71f0855e48c0 => generated 1292 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:02:21.725787 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-d2898209-d57b-4fc6-89d1-a14e8bd6101e tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:02:21.726403 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-d2898209-d57b-4fc6-89d1-a14e8bd6101e tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 65b7a5ff-be03-4f45-941c-26a50cdabf02] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:02:21.732951 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d2898209-d57b-4fc6-89d1-a14e8bd6101e tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:21.733393 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d2898209-d57b-4fc6-89d1-a14e8bd6101e tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:21.734159 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d2898209-d57b-4fc6-89d1-a14e8bd6101e tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:21.734694 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d2898209-d57b-4fc6-89d1-a14e8bd6101e tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:21.873981 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-d2898209-d57b-4fc6-89d1-a14e8bd6101e tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:02:21.878498 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:02:21.884247 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-d2898209-d57b-4fc6-89d1-a14e8bd6101e tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/65b7a5ff-be03-4f45-941c-26a50cdabf02" status: 200 len: 1733 microversion: 2.1 time: 0.163083 Jul 30 05:02:21.884824 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 343/652] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:02:21 2022] GET /compute/v2.1/servers/65b7a5ff-be03-4f45-941c-26a50cdabf02 => generated 1733 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:02:22.055049 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-ba8a92e8-f193-413f-8a28-2b13266aec9f tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:02:22.055668 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-ba8a92e8-f193-413f-8a28-2b13266aec9f tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] [instance: 366ac5bd-e8b9-46b5-8df3-509c48982078] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:02:22.062633 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ba8a92e8-f193-413f-8a28-2b13266aec9f tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:22.063092 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ba8a92e8-f193-413f-8a28-2b13266aec9f tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:22.063988 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ba8a92e8-f193-413f-8a28-2b13266aec9f tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:22.064427 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ba8a92e8-f193-413f-8a28-2b13266aec9f tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:22.069757 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:02:22.260262 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-ba8a92e8-f193-413f-8a28-2b13266aec9f tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334f2d8d9d9a4f7a90586999398f8a40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a02f6df4ed4365b3ce1fa970f9cf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:02:22.268298 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-ba8a92e8-f193-413f-8a28-2b13266aec9f tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] 10.222.0.20 "GET /compute/v2.1/servers/366ac5bd-e8b9-46b5-8df3-509c48982078" status: 200 len: 1318 microversion: 2.1 time: 0.217183 Jul 30 05:02:22.268941 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 310/653] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:02:22 2022] GET /compute/v2.1/servers/366ac5bd-e8b9-46b5-8df3-509c48982078 => generated 1318 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:02:22.493522 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-88fd6c96-90ca-4e4c-9a3b-cdd378f14ab7 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:02:22.494319 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-88fd6c96-90ca-4e4c-9a3b-cdd378f14ab7 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: 0a2aa4b1-2fd2-45e4-a058-71f0855e48c0] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:02:22.501528 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-88fd6c96-90ca-4e4c-9a3b-cdd378f14ab7 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:22.502126 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-88fd6c96-90ca-4e4c-9a3b-cdd378f14ab7 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:22.504450 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-88fd6c96-90ca-4e4c-9a3b-cdd378f14ab7 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:22.504690 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-88fd6c96-90ca-4e4c-9a3b-cdd378f14ab7 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:22.580775 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-88fd6c96-90ca-4e4c-9a3b-cdd378f14ab7 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8abb58f9c274e568d2d0fe3d4df11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01500cb03c74d1082090cd1c1836169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:02:22.589073 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-88fd6c96-90ca-4e4c-9a3b-cdd378f14ab7 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/0a2aa4b1-2fd2-45e4-a058-71f0855e48c0" status: 200 len: 1298 microversion: 2.1 time: 0.100314 Jul 30 05:02:22.590018 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 344/654] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:02:22 2022] GET /compute/v2.1/servers/0a2aa4b1-2fd2-45e4-a058-71f0855e48c0 => generated 1298 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:02:22.907174 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-2ef3289c-9b54-4976-b781-da8c6a551bd8 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:02:22.907796 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-2ef3289c-9b54-4976-b781-da8c6a551bd8 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 65b7a5ff-be03-4f45-941c-26a50cdabf02] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:02:22.914397 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2ef3289c-9b54-4976-b781-da8c6a551bd8 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:22.914905 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2ef3289c-9b54-4976-b781-da8c6a551bd8 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:22.915730 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2ef3289c-9b54-4976-b781-da8c6a551bd8 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:22.916123 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2ef3289c-9b54-4976-b781-da8c6a551bd8 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:23.108384 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-2ef3289c-9b54-4976-b781-da8c6a551bd8 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:02:23.116342 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-2ef3289c-9b54-4976-b781-da8c6a551bd8 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/65b7a5ff-be03-4f45-941c-26a50cdabf02" status: 200 len: 1733 microversion: 2.1 time: 0.213652 Jul 30 05:02:23.116915 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 311/655] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:02:22 2022] GET /compute/v2.1/servers/65b7a5ff-be03-4f45-941c-26a50cdabf02 => generated 1733 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:02:23.289713 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-1ffe226d-0d14-4c67-b4ad-d3f26ead6c8d tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:02:23.290362 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-1ffe226d-0d14-4c67-b4ad-d3f26ead6c8d tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] [instance: 366ac5bd-e8b9-46b5-8df3-509c48982078] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:02:23.297152 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1ffe226d-0d14-4c67-b4ad-d3f26ead6c8d tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:23.297612 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1ffe226d-0d14-4c67-b4ad-d3f26ead6c8d tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:23.298374 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1ffe226d-0d14-4c67-b4ad-d3f26ead6c8d tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:23.298851 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1ffe226d-0d14-4c67-b4ad-d3f26ead6c8d tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:23.431382 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-1ffe226d-0d14-4c67-b4ad-d3f26ead6c8d tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334f2d8d9d9a4f7a90586999398f8a40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a02f6df4ed4365b3ce1fa970f9cf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:02:23.439029 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-1ffe226d-0d14-4c67-b4ad-d3f26ead6c8d tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] 10.222.0.20 "GET /compute/v2.1/servers/366ac5bd-e8b9-46b5-8df3-509c48982078" status: 200 len: 1506 microversion: 2.1 time: 0.153211 Jul 30 05:02:23.439595 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 345/656] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:02:23 2022] GET /compute/v2.1/servers/366ac5bd-e8b9-46b5-8df3-509c48982078 => generated 1506 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:02:23.461256 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-8ddf4c12-59a7-4572-a92f-a57d49923d01 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "079c208c-70c1-4409-8e6e-7102ce54124b", "device": "/dev/sdb"}} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:02:23.464265 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-8ddf4c12-59a7-4572-a92f-a57d49923d01 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] [instance: 366ac5bd-e8b9-46b5-8df3-509c48982078] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:02:23.471189 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8ddf4c12-59a7-4572-a92f-a57d49923d01 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:23.471642 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8ddf4c12-59a7-4572-a92f-a57d49923d01 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:23.472414 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8ddf4c12-59a7-4572-a92f-a57d49923d01 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:23.472850 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8ddf4c12-59a7-4572-a92f-a57d49923d01 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:23.588537 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-8558ac55-a89b-4716-ba79-d03ca92184e5 req-3863d19c-fc3f-45f3-b771-341d77603704 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a2aa4b1-2fd2-45e4-a058-71f0855e48c0", "tag": "be23179b-b7b9-4f47-bb71-6ace62d54931"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:02:23.602276 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-8558ac55-a89b-4716-ba79-d03ca92184e5 req-3863d19c-fc3f-45f3-b771-341d77603704 service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:23.603070 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-8558ac55-a89b-4716-ba79-d03ca92184e5 req-3863d19c-fc3f-45f3-b771-341d77603704 service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:23.618095 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-8558ac55-a89b-4716-ba79-d03ca92184e5 req-3863d19c-fc3f-45f3-b771-341d77603704 service nova] Creating event network-changed:be23179b-b7b9-4f47-bb71-6ace62d54931 for instance 0a2aa4b1-2fd2-45e4-a058-71f0855e48c0 on hv-cinder-85127 Jul 30 05:02:23.625026 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-8558ac55-a89b-4716-ba79-d03ca92184e5 req-3863d19c-fc3f-45f3-b771-341d77603704 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041514 Jul 30 05:02:23.626145 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 346/657] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Jul 30 05:02:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 05:02:23.633129 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-2c0be101-88d3-44fa-a9ff-6553eb15e3de tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:02:23.633953 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-2c0be101-88d3-44fa-a9ff-6553eb15e3de tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: 0a2aa4b1-2fd2-45e4-a058-71f0855e48c0] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:02:23.640907 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2c0be101-88d3-44fa-a9ff-6553eb15e3de tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:23.641355 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2c0be101-88d3-44fa-a9ff-6553eb15e3de tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:23.642127 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2c0be101-88d3-44fa-a9ff-6553eb15e3de tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:23.642591 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2c0be101-88d3-44fa-a9ff-6553eb15e3de tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:23.779948 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-8ddf4c12-59a7-4572-a92f-a57d49923d01 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] 10.222.0.20 "POST /compute/v2.1/servers/366ac5bd-e8b9-46b5-8df3-509c48982078/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.322637 Jul 30 05:02:23.781409 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 312/658] 10.222.0.20 () {60 vars in 1323 bytes} [Sat Jul 30 05:02:23 2022] POST /compute/v2.1/servers/366ac5bd-e8b9-46b5-8df3-509c48982078/os-volume_attachments => generated 194 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 05:02:23.809922 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-2c0be101-88d3-44fa-a9ff-6553eb15e3de tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8abb58f9c274e568d2d0fe3d4df11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01500cb03c74d1082090cd1c1836169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:02:23.819596 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-2c0be101-88d3-44fa-a9ff-6553eb15e3de tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/0a2aa4b1-2fd2-45e4-a058-71f0855e48c0" status: 200 len: 1366 microversion: 2.1 time: 0.191774 Jul 30 05:02:23.821038 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 347/659] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:02:23 2022] GET /compute/v2.1/servers/0a2aa4b1-2fd2-45e4-a058-71f0855e48c0 => generated 1366 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:02:24.139109 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-529c28ce-e3d3-4da7-94cd-1b62b2dbcdf8 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:02:24.139803 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-529c28ce-e3d3-4da7-94cd-1b62b2dbcdf8 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 65b7a5ff-be03-4f45-941c-26a50cdabf02] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:02:24.147598 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-529c28ce-e3d3-4da7-94cd-1b62b2dbcdf8 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:24.148164 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-529c28ce-e3d3-4da7-94cd-1b62b2dbcdf8 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:24.149200 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-529c28ce-e3d3-4da7-94cd-1b62b2dbcdf8 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:24.149648 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-529c28ce-e3d3-4da7-94cd-1b62b2dbcdf8 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:24.369444 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-529c28ce-e3d3-4da7-94cd-1b62b2dbcdf8 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:02:24.378290 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-529c28ce-e3d3-4da7-94cd-1b62b2dbcdf8 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/65b7a5ff-be03-4f45-941c-26a50cdabf02" status: 200 len: 1733 microversion: 2.1 time: 0.242740 Jul 30 05:02:24.378985 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 313/660] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:02:24 2022] GET /compute/v2.1/servers/65b7a5ff-be03-4f45-941c-26a50cdabf02 => generated 1733 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:02:24.840558 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-ca4e0c86-4b57-4dc3-884d-c2574338a8a8 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:02:24.841182 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-ca4e0c86-4b57-4dc3-884d-c2574338a8a8 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: 0a2aa4b1-2fd2-45e4-a058-71f0855e48c0] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:02:24.847720 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ca4e0c86-4b57-4dc3-884d-c2574338a8a8 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:24.848174 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ca4e0c86-4b57-4dc3-884d-c2574338a8a8 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:24.848986 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ca4e0c86-4b57-4dc3-884d-c2574338a8a8 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:24.849431 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ca4e0c86-4b57-4dc3-884d-c2574338a8a8 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:25.000129 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-ca4e0c86-4b57-4dc3-884d-c2574338a8a8 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8abb58f9c274e568d2d0fe3d4df11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01500cb03c74d1082090cd1c1836169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:02:25.008409 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-ca4e0c86-4b57-4dc3-884d-c2574338a8a8 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/0a2aa4b1-2fd2-45e4-a058-71f0855e48c0" status: 200 len: 1366 microversion: 2.1 time: 0.171962 Jul 30 05:02:25.008993 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 348/661] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:02:24 2022] GET /compute/v2.1/servers/0a2aa4b1-2fd2-45e4-a058-71f0855e48c0 => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:02:25.400421 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-5ebeef29-4c48-4f3a-a544-16de513f3575 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:02:25.401030 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-5ebeef29-4c48-4f3a-a544-16de513f3575 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 65b7a5ff-be03-4f45-941c-26a50cdabf02] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:02:25.407491 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5ebeef29-4c48-4f3a-a544-16de513f3575 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:25.407940 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5ebeef29-4c48-4f3a-a544-16de513f3575 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:25.408691 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5ebeef29-4c48-4f3a-a544-16de513f3575 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:25.409154 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5ebeef29-4c48-4f3a-a544-16de513f3575 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:25.623751 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-5ebeef29-4c48-4f3a-a544-16de513f3575 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:02:25.632206 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-5ebeef29-4c48-4f3a-a544-16de513f3575 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/65b7a5ff-be03-4f45-941c-26a50cdabf02" status: 200 len: 1733 microversion: 2.1 time: 0.235606 Jul 30 05:02:25.632783 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 314/662] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:02:25 2022] GET /compute/v2.1/servers/65b7a5ff-be03-4f45-941c-26a50cdabf02 => generated 1733 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:02:26.029104 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-59e45a3f-5286-4f5d-9e2d-1b1866e8a70b tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:02:26.030350 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-59e45a3f-5286-4f5d-9e2d-1b1866e8a70b tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: 0a2aa4b1-2fd2-45e4-a058-71f0855e48c0] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:02:26.039275 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-59e45a3f-5286-4f5d-9e2d-1b1866e8a70b tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:26.039728 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-59e45a3f-5286-4f5d-9e2d-1b1866e8a70b tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:26.040504 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-59e45a3f-5286-4f5d-9e2d-1b1866e8a70b tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:26.040948 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-59e45a3f-5286-4f5d-9e2d-1b1866e8a70b tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:26.175276 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-59e45a3f-5286-4f5d-9e2d-1b1866e8a70b tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8abb58f9c274e568d2d0fe3d4df11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01500cb03c74d1082090cd1c1836169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:02:26.182852 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-59e45a3f-5286-4f5d-9e2d-1b1866e8a70b tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/0a2aa4b1-2fd2-45e4-a058-71f0855e48c0" status: 200 len: 1366 microversion: 2.1 time: 0.157577 Jul 30 05:02:26.183494 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 349/663] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:02:26 2022] GET /compute/v2.1/servers/0a2aa4b1-2fd2-45e4-a058-71f0855e48c0 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:02:26.654672 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-1477bccf-da0a-4f9d-a20f-bbc8cf1a3fe0 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:02:26.655677 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-1477bccf-da0a-4f9d-a20f-bbc8cf1a3fe0 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 65b7a5ff-be03-4f45-941c-26a50cdabf02] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:02:26.663947 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1477bccf-da0a-4f9d-a20f-bbc8cf1a3fe0 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:26.664401 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1477bccf-da0a-4f9d-a20f-bbc8cf1a3fe0 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:26.665177 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1477bccf-da0a-4f9d-a20f-bbc8cf1a3fe0 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:26.665643 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1477bccf-da0a-4f9d-a20f-bbc8cf1a3fe0 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:26.816156 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-1477bccf-da0a-4f9d-a20f-bbc8cf1a3fe0 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:02:26.824911 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-1477bccf-da0a-4f9d-a20f-bbc8cf1a3fe0 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/65b7a5ff-be03-4f45-941c-26a50cdabf02" status: 200 len: 1733 microversion: 2.1 time: 0.175125 Jul 30 05:02:26.825513 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 315/664] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:02:26 2022] GET /compute/v2.1/servers/65b7a5ff-be03-4f45-941c-26a50cdabf02 => generated 1733 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:02:27.203710 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-625686e0-6976-43b3-ac66-a409690cb56e tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:02:27.204324 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-625686e0-6976-43b3-ac66-a409690cb56e tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: 0a2aa4b1-2fd2-45e4-a058-71f0855e48c0] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:02:27.211538 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-625686e0-6976-43b3-ac66-a409690cb56e tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:27.211981 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-625686e0-6976-43b3-ac66-a409690cb56e tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:27.212755 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-625686e0-6976-43b3-ac66-a409690cb56e tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:27.213177 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-625686e0-6976-43b3-ac66-a409690cb56e tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:27.342125 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-625686e0-6976-43b3-ac66-a409690cb56e tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8abb58f9c274e568d2d0fe3d4df11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01500cb03c74d1082090cd1c1836169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:02:27.349606 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-625686e0-6976-43b3-ac66-a409690cb56e tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/0a2aa4b1-2fd2-45e4-a058-71f0855e48c0" status: 200 len: 1366 microversion: 2.1 time: 0.149798 Jul 30 05:02:27.350172 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 350/665] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:02:27 2022] GET /compute/v2.1/servers/0a2aa4b1-2fd2-45e4-a058-71f0855e48c0 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:02:27.850642 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-645b3e7c-9239-442f-926a-71898d4b46e0 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:02:27.851252 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-645b3e7c-9239-442f-926a-71898d4b46e0 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 65b7a5ff-be03-4f45-941c-26a50cdabf02] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:02:27.857706 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-645b3e7c-9239-442f-926a-71898d4b46e0 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:27.858150 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-645b3e7c-9239-442f-926a-71898d4b46e0 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:27.858934 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-645b3e7c-9239-442f-926a-71898d4b46e0 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:27.859371 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-645b3e7c-9239-442f-926a-71898d4b46e0 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:27.987520 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-645b3e7c-9239-442f-926a-71898d4b46e0 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:02:27.996411 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-645b3e7c-9239-442f-926a-71898d4b46e0 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/65b7a5ff-be03-4f45-941c-26a50cdabf02" status: 200 len: 1733 microversion: 2.1 time: 0.150145 Jul 30 05:02:27.996981 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 316/666] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:02:27 2022] GET /compute/v2.1/servers/65b7a5ff-be03-4f45-941c-26a50cdabf02 => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:02:28.370337 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-55743184-3a0f-4889-91c4-ebe47dfb35d2 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:02:28.370988 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-55743184-3a0f-4889-91c4-ebe47dfb35d2 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: 0a2aa4b1-2fd2-45e4-a058-71f0855e48c0] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:02:28.377392 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-55743184-3a0f-4889-91c4-ebe47dfb35d2 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:28.377840 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-55743184-3a0f-4889-91c4-ebe47dfb35d2 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:28.378620 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-55743184-3a0f-4889-91c4-ebe47dfb35d2 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:28.379331 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-55743184-3a0f-4889-91c4-ebe47dfb35d2 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:28.511401 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-55743184-3a0f-4889-91c4-ebe47dfb35d2 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8abb58f9c274e568d2d0fe3d4df11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01500cb03c74d1082090cd1c1836169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:02:28.518733 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-55743184-3a0f-4889-91c4-ebe47dfb35d2 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/0a2aa4b1-2fd2-45e4-a058-71f0855e48c0" status: 200 len: 1366 microversion: 2.1 time: 0.152205 Jul 30 05:02:28.519317 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 351/667] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:02:28 2022] GET /compute/v2.1/servers/0a2aa4b1-2fd2-45e4-a058-71f0855e48c0 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:02:29.021672 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-d6b2b940-7c03-4026-9ff9-341bba52b041 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:02:29.022293 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-d6b2b940-7c03-4026-9ff9-341bba52b041 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 65b7a5ff-be03-4f45-941c-26a50cdabf02] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:02:29.028867 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d6b2b940-7c03-4026-9ff9-341bba52b041 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:29.029324 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d6b2b940-7c03-4026-9ff9-341bba52b041 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:29.030099 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d6b2b940-7c03-4026-9ff9-341bba52b041 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:29.030573 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d6b2b940-7c03-4026-9ff9-341bba52b041 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:29.163775 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-d6b2b940-7c03-4026-9ff9-341bba52b041 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:02:29.173251 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-d6b2b940-7c03-4026-9ff9-341bba52b041 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/65b7a5ff-be03-4f45-941c-26a50cdabf02" status: 200 len: 1733 microversion: 2.1 time: 0.156160 Jul 30 05:02:29.182522 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 317/668] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:02:29 2022] GET /compute/v2.1/servers/65b7a5ff-be03-4f45-941c-26a50cdabf02 => generated 1733 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:02:29.539394 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-d40c3b39-c225-4192-8987-f4027837a1ae tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:02:29.540012 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-d40c3b39-c225-4192-8987-f4027837a1ae tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: 0a2aa4b1-2fd2-45e4-a058-71f0855e48c0] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:02:29.546806 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d40c3b39-c225-4192-8987-f4027837a1ae tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:29.547255 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d40c3b39-c225-4192-8987-f4027837a1ae tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:29.548023 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d40c3b39-c225-4192-8987-f4027837a1ae tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:29.548462 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d40c3b39-c225-4192-8987-f4027837a1ae tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:29.674315 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-d40c3b39-c225-4192-8987-f4027837a1ae tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8abb58f9c274e568d2d0fe3d4df11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01500cb03c74d1082090cd1c1836169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:02:29.682213 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-d40c3b39-c225-4192-8987-f4027837a1ae tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/0a2aa4b1-2fd2-45e4-a058-71f0855e48c0" status: 200 len: 1366 microversion: 2.1 time: 0.146906 Jul 30 05:02:29.682809 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 352/669] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:02:29 2022] GET /compute/v2.1/servers/0a2aa4b1-2fd2-45e4-a058-71f0855e48c0 => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:02:30.196168 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-76977731-8d2d-4b50-91e8-744e4217393d tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:02:30.196780 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-76977731-8d2d-4b50-91e8-744e4217393d tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 65b7a5ff-be03-4f45-941c-26a50cdabf02] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:02:30.203225 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-76977731-8d2d-4b50-91e8-744e4217393d tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:30.203674 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-76977731-8d2d-4b50-91e8-744e4217393d tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:30.204432 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-76977731-8d2d-4b50-91e8-744e4217393d tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:30.204868 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-76977731-8d2d-4b50-91e8-744e4217393d tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:30.340199 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-76977731-8d2d-4b50-91e8-744e4217393d tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:02:30.348022 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-76977731-8d2d-4b50-91e8-744e4217393d tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/65b7a5ff-be03-4f45-941c-26a50cdabf02" status: 200 len: 1733 microversion: 2.1 time: 0.156640 Jul 30 05:02:30.348578 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 318/670] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:02:30 2022] GET /compute/v2.1/servers/65b7a5ff-be03-4f45-941c-26a50cdabf02 => generated 1733 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:02:30.700642 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell0:SELECT=2 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:02:30.701784 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell0:SELECT=6 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:02:30.706325 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-05f114ef-47d7-44f7-8d0f-87d04add3d99 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:02:30.707016 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-05f114ef-47d7-44f7-8d0f-87d04add3d99 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: 0a2aa4b1-2fd2-45e4-a058-71f0855e48c0] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:02:30.714264 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-05f114ef-47d7-44f7-8d0f-87d04add3d99 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:30.714723 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-05f114ef-47d7-44f7-8d0f-87d04add3d99 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:30.715502 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-05f114ef-47d7-44f7-8d0f-87d04add3d99 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:30.715942 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-05f114ef-47d7-44f7-8d0f-87d04add3d99 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:30.783582 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-c5ef29e7-8a1a-4ef5-ade5-18d9581034bd req-7d4f6355-b7e8-444f-9422-ef97a94d2f4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a2aa4b1-2fd2-45e4-a058-71f0855e48c0", "name": "network-vif-plugged", "status": "completed", "tag": "be23179b-b7b9-4f47-bb71-6ace62d54931"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:02:30.791136 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell0:SELECT=8 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:02:30.798762 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-c5ef29e7-8a1a-4ef5-ade5-18d9581034bd req-7d4f6355-b7e8-444f-9422-ef97a94d2f4b service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:30.799212 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-c5ef29e7-8a1a-4ef5-ade5-18d9581034bd req-7d4f6355-b7e8-444f-9422-ef97a94d2f4b service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:30.813922 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-c5ef29e7-8a1a-4ef5-ade5-18d9581034bd req-7d4f6355-b7e8-444f-9422-ef97a94d2f4b service nova] Creating event network-vif-plugged:be23179b-b7b9-4f47-bb71-6ace62d54931 for instance 0a2aa4b1-2fd2-45e4-a058-71f0855e48c0 on hv-cinder-85127 Jul 30 05:02:30.821408 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-c5ef29e7-8a1a-4ef5-ade5-18d9581034bd req-7d4f6355-b7e8-444f-9422-ef97a94d2f4b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043505 Jul 30 05:02:30.822177 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 319/671] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Jul 30 05:02:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 05:02:30.877748 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-05f114ef-47d7-44f7-8d0f-87d04add3d99 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8abb58f9c274e568d2d0fe3d4df11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01500cb03c74d1082090cd1c1836169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:02:30.885779 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-05f114ef-47d7-44f7-8d0f-87d04add3d99 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/0a2aa4b1-2fd2-45e4-a058-71f0855e48c0" status: 200 len: 1366 microversion: 2.1 time: 0.185989 Jul 30 05:02:30.886354 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 353/672] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:02:30 2022] GET /compute/v2.1/servers/0a2aa4b1-2fd2-45e4-a058-71f0855e48c0 => generated 1366 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 05:02:31.370469 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-30490502-66fb-4fcd-9ffc-acaee7ffbbfe tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:02:31.371305 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-30490502-66fb-4fcd-9ffc-acaee7ffbbfe tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 65b7a5ff-be03-4f45-941c-26a50cdabf02] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:02:31.377483 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-30490502-66fb-4fcd-9ffc-acaee7ffbbfe tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:31.378010 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-30490502-66fb-4fcd-9ffc-acaee7ffbbfe tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:31.378895 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-30490502-66fb-4fcd-9ffc-acaee7ffbbfe tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:31.379328 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-30490502-66fb-4fcd-9ffc-acaee7ffbbfe tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:31.530217 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-30490502-66fb-4fcd-9ffc-acaee7ffbbfe tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:02:31.539081 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-30490502-66fb-4fcd-9ffc-acaee7ffbbfe tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/65b7a5ff-be03-4f45-941c-26a50cdabf02" status: 200 len: 1713 microversion: 2.1 time: 0.173293 Jul 30 05:02:31.539641 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 320/673] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:02:31 2022] GET /compute/v2.1/servers/65b7a5ff-be03-4f45-941c-26a50cdabf02 => generated 1713 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:02:31.650729 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-43eb4695-0b24-44d6-9105-af4b1ee2e096 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:02:31.651266 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-43eb4695-0b24-44d6-9105-af4b1ee2e096 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 65b7a5ff-be03-4f45-941c-26a50cdabf02] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:02:31.657259 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-43eb4695-0b24-44d6-9105-af4b1ee2e096 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:31.657718 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-43eb4695-0b24-44d6-9105-af4b1ee2e096 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:31.658511 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-43eb4695-0b24-44d6-9105-af4b1ee2e096 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:31.658956 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-43eb4695-0b24-44d6-9105-af4b1ee2e096 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:31.806363 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.wsgi [None req-43eb4695-0b24-44d6-9105-af4b1ee2e096 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] HTTP exception thrown: Cannot 'detach_volume' instance 65b7a5ff-be03-4f45-941c-26a50cdabf02 while it is in vm_state rescued Jul 30 05:02:31.807973 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-43eb4695-0b24-44d6-9105-af4b1ee2e096 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Request method failure captured: Jul 30 05:02:31.807973 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: request: DELETE /compute/v2.1/servers/65b7a5ff-be03-4f45-941c-26a50cdabf02/os-volume_attachments/d413de6f-e0d4-4e0d-958b-99855c762397 HTTP/1.1 Jul 30 05:02:31.807973 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Accept: application/json Jul 30 05:02:31.807973 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Accept-Encoding: identity Jul 30 05:02:31.807973 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Connection: close Jul 30 05:02:31.807973 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Content-Length: 0 Jul 30 05:02:31.807973 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Content-Type: application/json Jul 30 05:02:31.807973 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Host: 10.222.0.20 Jul 30 05:02:31.807973 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Openstack-System-Scope: None Jul 30 05:02:31.807973 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: User-Agent: python-urllib3/1.26.10 Jul 30 05:02:31.807973 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Auth-Token: gAAAAABi5Lpu5KZ-sBOjkiuZTtNR2YWcqU_r-_-3UQQ04xAT-w7gK_BuaWmEOr5Ju1pwtkZZzl_OTo-ZEKY-uHmyReS4PYVQ4M2aEskgI5yNySqgQDIjC3jupbHgF4azyUEFhR8JjMfCOfjvUulaZeOLaDw7yo-4-VTWVyQqf3A9DFmnALqdkU8 Jul 30 05:02:31.807973 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Domain-Id: None Jul 30 05:02:31.807973 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Domain-Name: None Jul 30 05:02:31.807973 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Identity-Status: Confirmed Jul 30 05:02:31.807973 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Is-Admin-Project: True Jul 30 05:02:31.807973 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Project-Domain-Id: default Jul 30 05:02:31.807973 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Project-Domain-Name: Default Jul 30 05:02:31.807973 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Project-Id: decb0bd64582440590890900e594b79e Jul 30 05:02:31.807973 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-243408600 Jul 30 05:02:31.807973 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Role: member,reader Jul 30 05:02:31.807973 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Roles: member,reader Jul 30 05:02:31.809501 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/decb0bd64582440590890900e594b79e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/decb0bd64582440590890900e594b79e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_decb0bd64582440590890900e594b79e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/decb0bd64582440590890900e594b79e"}]}] Jul 30 05:02:31.809501 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Tenant: tempest-ServerRescueNegativeTestJSON-243408600 Jul 30 05:02:31.809501 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Tenant-Id: decb0bd64582440590890900e594b79e Jul 30 05:02:31.809501 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-243408600 Jul 30 05:02:31.809501 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User: tempest-ServerRescueNegativeTestJSON-243408600-project Jul 30 05:02:31.809501 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User-Domain-Id: default Jul 30 05:02:31.809501 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User-Domain-Name: Default Jul 30 05:02:31.809501 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User-Id: 25db6f7402ae4a14a04fab0a9915ab77 Jul 30 05:02:31.809501 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User-Name: tempest-ServerRescueNegativeTestJSON-243408600-project Jul 30 05:02:31.809501 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: method: > Jul 30 05:02:31.809501 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: exception: Cannot 'detach_volume' instance 65b7a5ff-be03-4f45-941c-26a50cdabf02 while it is in vm_state rescued Jul 30 05:02:31.810316 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: action_args: {'server_id': '65b7a5ff-be03-4f45-941c-26a50cdabf02', 'id': 'd413de6f-e0d4-4e0d-958b-99855c762397'} Jul 30 05:02:31.810316 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 05:02:31.810316 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:02:31.810316 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 30 05:02:31.810316 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 30 05:02:31.810316 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 30 05:02:31.810316 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 30 05:02:31.810316 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 30 05:02:31.810316 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 30 05:02:31.810316 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 65b7a5ff-be03-4f45-941c-26a50cdabf02 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 30 05:02:31.810316 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 05:02:31.810316 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 05:02:31.810316 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 05:02:31.810316 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:02:31.810316 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 05:02:31.810316 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 05:02:31.810316 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 05:02:31.810316 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 05:02:31.810316 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 05:02:31.810316 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 05:02:31.811818 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 30 05:02:31.811818 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 30 05:02:31.811818 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 30 05:02:31.811818 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 30 05:02:31.811818 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 65b7a5ff-be03-4f45-941c-26a50cdabf02 while it is in vm_state rescued Jul 30 05:02:31.811818 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 05:02:31.811818 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 05:02:31.811818 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 05:02:31.811818 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:02:31.811818 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 05:02:31.811818 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 05:02:31.811818 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 05:02:31.811818 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 05:02:31.811818 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 65b7a5ff-be03-4f45-941c-26a50cdabf02 while it is in vm_state rescued Jul 30 05:02:31.811818 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 05:02:31.811818 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-43eb4695-0b24-44d6-9105-af4b1ee2e096 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Returning 409 to user: Cannot 'detach_volume' instance 65b7a5ff-be03-4f45-941c-26a50cdabf02 while it is in vm_state rescued {{(pid=117886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 05:02:31.812983 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-43eb4695-0b24-44d6-9105-af4b1ee2e096 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "DELETE /compute/v2.1/servers/65b7a5ff-be03-4f45-941c-26a50cdabf02/os-volume_attachments/d413de6f-e0d4-4e0d-958b-99855c762397" status: 409 len: 152 microversion: 2.1 time: 0.162788 Jul 30 05:02:31.812983 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 354/674] 10.222.0.20 () {58 vars in 1416 bytes} [Sat Jul 30 05:02:31 2022] DELETE /compute/v2.1/servers/65b7a5ff-be03-4f45-941c-26a50cdabf02/os-volume_attachments/d413de6f-e0d4-4e0d-958b-99855c762397 => generated 152 bytes in 165 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 30 05:02:31.818913 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-cfeb2eee-d6b4-4936-adc3-ece61d8bce67 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:02:31.819444 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-cfeb2eee-d6b4-4936-adc3-ece61d8bce67 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 65b7a5ff-be03-4f45-941c-26a50cdabf02] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:02:31.825280 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-cfeb2eee-d6b4-4936-adc3-ece61d8bce67 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:31.825725 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-cfeb2eee-d6b4-4936-adc3-ece61d8bce67 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:31.826501 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-cfeb2eee-d6b4-4936-adc3-ece61d8bce67 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:31.826934 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-cfeb2eee-d6b4-4936-adc3-ece61d8bce67 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:31.892788 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-cfeb2eee-d6b4-4936-adc3-ece61d8bce67 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "POST /compute/v2.1/servers/65b7a5ff-be03-4f45-941c-26a50cdabf02/action" status: 202 len: 0 microversion: 2.1 time: 0.078177 Jul 30 05:02:31.893545 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 321/675] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Jul 30 05:02:31 2022] POST /compute/v2.1/servers/65b7a5ff-be03-4f45-941c-26a50cdabf02/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 05:02:31.902017 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-0e11b709-7cc8-4438-9a51-2e6365e8333d tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:02:31.902988 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-0e11b709-7cc8-4438-9a51-2e6365e8333d tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 65b7a5ff-be03-4f45-941c-26a50cdabf02] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:02:31.907514 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-dd0abf01-1892-4187-8e19-0d67a0b108c5 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:02:31.908216 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-dd0abf01-1892-4187-8e19-0d67a0b108c5 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: 0a2aa4b1-2fd2-45e4-a058-71f0855e48c0] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:02:31.909625 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0e11b709-7cc8-4438-9a51-2e6365e8333d tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:31.910107 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0e11b709-7cc8-4438-9a51-2e6365e8333d tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:31.910988 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0e11b709-7cc8-4438-9a51-2e6365e8333d tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:31.911467 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0e11b709-7cc8-4438-9a51-2e6365e8333d tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:31.914545 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-dd0abf01-1892-4187-8e19-0d67a0b108c5 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:31.914989 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-dd0abf01-1892-4187-8e19-0d67a0b108c5 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:31.915743 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-dd0abf01-1892-4187-8e19-0d67a0b108c5 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:31.916284 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-dd0abf01-1892-4187-8e19-0d67a0b108c5 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:32.047966 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-dd0abf01-1892-4187-8e19-0d67a0b108c5 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8abb58f9c274e568d2d0fe3d4df11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01500cb03c74d1082090cd1c1836169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:02:32.052920 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-0e11b709-7cc8-4438-9a51-2e6365e8333d tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:02:32.056799 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-dd0abf01-1892-4187-8e19-0d67a0b108c5 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/0a2aa4b1-2fd2-45e4-a058-71f0855e48c0" status: 200 len: 1366 microversion: 2.1 time: 0.153334 Jul 30 05:02:32.057382 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 322/676] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:02:31 2022] GET /compute/v2.1/servers/0a2aa4b1-2fd2-45e4-a058-71f0855e48c0 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:02:32.061520 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-0e11b709-7cc8-4438-9a51-2e6365e8333d tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/65b7a5ff-be03-4f45-941c-26a50cdabf02" status: 200 len: 1721 microversion: 2.1 time: 0.163172 Jul 30 05:02:32.062084 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 355/677] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:02:31 2022] GET /compute/v2.1/servers/65b7a5ff-be03-4f45-941c-26a50cdabf02 => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:02:33.077435 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-4e219875-d878-4cfc-82f5-469b3e87c3f4 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:02:33.078139 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-4e219875-d878-4cfc-82f5-469b3e87c3f4 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: 0a2aa4b1-2fd2-45e4-a058-71f0855e48c0] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:02:33.083334 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-940def64-5204-4b04-851c-401c6c957ef3 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:02:33.083977 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-940def64-5204-4b04-851c-401c6c957ef3 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 65b7a5ff-be03-4f45-941c-26a50cdabf02] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:02:33.085859 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4e219875-d878-4cfc-82f5-469b3e87c3f4 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:33.086315 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4e219875-d878-4cfc-82f5-469b3e87c3f4 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:33.087115 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4e219875-d878-4cfc-82f5-469b3e87c3f4 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:33.087557 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4e219875-d878-4cfc-82f5-469b3e87c3f4 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:33.090391 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-940def64-5204-4b04-851c-401c6c957ef3 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:33.090928 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-940def64-5204-4b04-851c-401c6c957ef3 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:33.091764 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-940def64-5204-4b04-851c-401c6c957ef3 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:33.092199 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-940def64-5204-4b04-851c-401c6c957ef3 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:33.221801 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-940def64-5204-4b04-851c-401c6c957ef3 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:02:33.224126 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-4e219875-d878-4cfc-82f5-469b3e87c3f4 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8abb58f9c274e568d2d0fe3d4df11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01500cb03c74d1082090cd1c1836169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:02:33.230001 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-940def64-5204-4b04-851c-401c6c957ef3 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/65b7a5ff-be03-4f45-941c-26a50cdabf02" status: 200 len: 1721 microversion: 2.1 time: 0.150970 Jul 30 05:02:33.230602 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 356/678] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:02:33 2022] GET /compute/v2.1/servers/65b7a5ff-be03-4f45-941c-26a50cdabf02 => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:02:33.235534 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-4e219875-d878-4cfc-82f5-469b3e87c3f4 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/0a2aa4b1-2fd2-45e4-a058-71f0855e48c0" status: 200 len: 1366 microversion: 2.1 time: 0.161868 Jul 30 05:02:33.236242 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 323/679] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:02:33 2022] GET /compute/v2.1/servers/0a2aa4b1-2fd2-45e4-a058-71f0855e48c0 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:02:34.251472 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-4eba7762-93f2-47a2-9f11-69ae28a8591a tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:02:34.252118 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-4eba7762-93f2-47a2-9f11-69ae28a8591a tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 65b7a5ff-be03-4f45-941c-26a50cdabf02] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:02:34.256297 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-8d2cbfba-b8f0-4966-b936-b54d60e35d8e tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:02:34.256913 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-8d2cbfba-b8f0-4966-b936-b54d60e35d8e tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: 0a2aa4b1-2fd2-45e4-a058-71f0855e48c0] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:02:34.259394 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4eba7762-93f2-47a2-9f11-69ae28a8591a tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:34.259845 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4eba7762-93f2-47a2-9f11-69ae28a8591a tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:34.260605 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4eba7762-93f2-47a2-9f11-69ae28a8591a tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:34.261034 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4eba7762-93f2-47a2-9f11-69ae28a8591a tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:34.263658 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8d2cbfba-b8f0-4966-b936-b54d60e35d8e tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:34.264103 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8d2cbfba-b8f0-4966-b936-b54d60e35d8e tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:34.265139 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8d2cbfba-b8f0-4966-b936-b54d60e35d8e tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:34.265581 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8d2cbfba-b8f0-4966-b936-b54d60e35d8e tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:34.397324 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-8d2cbfba-b8f0-4966-b936-b54d60e35d8e tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8abb58f9c274e568d2d0fe3d4df11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01500cb03c74d1082090cd1c1836169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:02:34.400234 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-4eba7762-93f2-47a2-9f11-69ae28a8591a tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:02:34.404942 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-8d2cbfba-b8f0-4966-b936-b54d60e35d8e tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/0a2aa4b1-2fd2-45e4-a058-71f0855e48c0" status: 200 len: 1366 microversion: 2.1 time: 0.153091 Jul 30 05:02:34.405515 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 324/680] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:02:34 2022] GET /compute/v2.1/servers/0a2aa4b1-2fd2-45e4-a058-71f0855e48c0 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 05:02:34.408379 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-4eba7762-93f2-47a2-9f11-69ae28a8591a tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/65b7a5ff-be03-4f45-941c-26a50cdabf02" status: 200 len: 1721 microversion: 2.1 time: 0.160686 Jul 30 05:02:34.408932 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 357/681] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:02:34 2022] GET /compute/v2.1/servers/65b7a5ff-be03-4f45-941c-26a50cdabf02 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:02:35.426661 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-6f8d7bc3-f545-4bed-97dd-e47df51603fd tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:02:35.427283 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-6f8d7bc3-f545-4bed-97dd-e47df51603fd tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: 0a2aa4b1-2fd2-45e4-a058-71f0855e48c0] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:02:35.429002 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-500f9cb1-846b-4ca0-9a43-428112e568ee tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:02:35.429613 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-500f9cb1-846b-4ca0-9a43-428112e568ee tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 65b7a5ff-be03-4f45-941c-26a50cdabf02] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:02:35.433743 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6f8d7bc3-f545-4bed-97dd-e47df51603fd tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:35.434195 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6f8d7bc3-f545-4bed-97dd-e47df51603fd tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:35.434996 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6f8d7bc3-f545-4bed-97dd-e47df51603fd tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:35.435436 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6f8d7bc3-f545-4bed-97dd-e47df51603fd tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:35.435957 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-500f9cb1-846b-4ca0-9a43-428112e568ee tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:35.436403 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-500f9cb1-846b-4ca0-9a43-428112e568ee tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:35.437155 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-500f9cb1-846b-4ca0-9a43-428112e568ee tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:35.437586 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-500f9cb1-846b-4ca0-9a43-428112e568ee tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:35.439472 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:02:35.570646 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-500f9cb1-846b-4ca0-9a43-428112e568ee tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:02:35.577106 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-6f8d7bc3-f545-4bed-97dd-e47df51603fd tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8abb58f9c274e568d2d0fe3d4df11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01500cb03c74d1082090cd1c1836169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:02:35.579041 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-500f9cb1-846b-4ca0-9a43-428112e568ee tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/65b7a5ff-be03-4f45-941c-26a50cdabf02" status: 200 len: 1721 microversion: 2.1 time: 0.153890 Jul 30 05:02:35.589782 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 358/682] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:02:35 2022] GET /compute/v2.1/servers/65b7a5ff-be03-4f45-941c-26a50cdabf02 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 05:02:35.590495 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-6f8d7bc3-f545-4bed-97dd-e47df51603fd tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/0a2aa4b1-2fd2-45e4-a058-71f0855e48c0" status: 200 len: 1366 microversion: 2.1 time: 0.162313 Jul 30 05:02:35.590495 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 325/683] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:02:35 2022] GET /compute/v2.1/servers/0a2aa4b1-2fd2-45e4-a058-71f0855e48c0 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:02:36.602775 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-fe88ba84-d021-48e5-b449-5747002fbe9b tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:02:36.603386 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-fe88ba84-d021-48e5-b449-5747002fbe9b tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 65b7a5ff-be03-4f45-941c-26a50cdabf02] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:02:36.604741 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-7fc93438-7165-4d31-aa15-cdd878f0070d tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:02:36.605366 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-7fc93438-7165-4d31-aa15-cdd878f0070d tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: 0a2aa4b1-2fd2-45e4-a058-71f0855e48c0] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:02:36.609930 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fe88ba84-d021-48e5-b449-5747002fbe9b tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:36.610378 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fe88ba84-d021-48e5-b449-5747002fbe9b tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:36.611171 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fe88ba84-d021-48e5-b449-5747002fbe9b tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:36.611600 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fe88ba84-d021-48e5-b449-5747002fbe9b tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:36.611704 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7fc93438-7165-4d31-aa15-cdd878f0070d tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:36.612122 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7fc93438-7165-4d31-aa15-cdd878f0070d tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:36.612887 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7fc93438-7165-4d31-aa15-cdd878f0070d tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:36.613925 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7fc93438-7165-4d31-aa15-cdd878f0070d tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:36.745726 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-fe88ba84-d021-48e5-b449-5747002fbe9b tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:02:36.749214 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-7fc93438-7165-4d31-aa15-cdd878f0070d tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8abb58f9c274e568d2d0fe3d4df11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01500cb03c74d1082090cd1c1836169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:02:36.754730 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-fe88ba84-d021-48e5-b449-5747002fbe9b tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/65b7a5ff-be03-4f45-941c-26a50cdabf02" status: 200 len: 1721 microversion: 2.1 time: 0.155096 Jul 30 05:02:36.755389 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 359/684] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:02:36 2022] GET /compute/v2.1/servers/65b7a5ff-be03-4f45-941c-26a50cdabf02 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:02:36.758293 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-7fc93438-7165-4d31-aa15-cdd878f0070d tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/0a2aa4b1-2fd2-45e4-a058-71f0855e48c0" status: 200 len: 1366 microversion: 2.1 time: 0.156564 Jul 30 05:02:36.758293 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 326/685] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:02:36 2022] GET /compute/v2.1/servers/0a2aa4b1-2fd2-45e4-a058-71f0855e48c0 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 05:02:37.776168 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-fbc4b812-86b1-4a7f-9c70-2eeb3750b28b tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:02:37.776781 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-fbc4b812-86b1-4a7f-9c70-2eeb3750b28b tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 65b7a5ff-be03-4f45-941c-26a50cdabf02] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:02:37.777181 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-9ec4e832-750e-469b-92da-9d544577f3f6 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:02:37.777798 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-9ec4e832-750e-469b-92da-9d544577f3f6 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: 0a2aa4b1-2fd2-45e4-a058-71f0855e48c0] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:02:37.783355 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fbc4b812-86b1-4a7f-9c70-2eeb3750b28b tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:37.783812 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fbc4b812-86b1-4a7f-9c70-2eeb3750b28b tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:37.784101 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9ec4e832-750e-469b-92da-9d544577f3f6 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:37.784559 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9ec4e832-750e-469b-92da-9d544577f3f6 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:37.784664 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fbc4b812-86b1-4a7f-9c70-2eeb3750b28b tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:37.785522 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fbc4b812-86b1-4a7f-9c70-2eeb3750b28b tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:37.785973 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9ec4e832-750e-469b-92da-9d544577f3f6 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:37.786414 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9ec4e832-750e-469b-92da-9d544577f3f6 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:37.923750 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-fbc4b812-86b1-4a7f-9c70-2eeb3750b28b tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:02:37.925783 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-9ec4e832-750e-469b-92da-9d544577f3f6 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8abb58f9c274e568d2d0fe3d4df11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01500cb03c74d1082090cd1c1836169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:02:37.933821 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-fbc4b812-86b1-4a7f-9c70-2eeb3750b28b tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/65b7a5ff-be03-4f45-941c-26a50cdabf02" status: 200 len: 1721 microversion: 2.1 time: 0.161419 Jul 30 05:02:37.934814 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 360/686] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:02:37 2022] GET /compute/v2.1/servers/65b7a5ff-be03-4f45-941c-26a50cdabf02 => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:02:37.934972 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-9ec4e832-750e-469b-92da-9d544577f3f6 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/0a2aa4b1-2fd2-45e4-a058-71f0855e48c0" status: 200 len: 1366 microversion: 2.1 time: 0.161341 Jul 30 05:02:37.935696 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 327/687] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:02:37 2022] GET /compute/v2.1/servers/0a2aa4b1-2fd2-45e4-a058-71f0855e48c0 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 05:02:38.955333 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-db1c2e13-b3f6-4c7e-8f49-4212c0717ebd tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:02:38.955888 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-79b7988b-7b2a-4588-a511-a383487ccd35 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:02:38.956264 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-db1c2e13-b3f6-4c7e-8f49-4212c0717ebd tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 65b7a5ff-be03-4f45-941c-26a50cdabf02] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:02:38.956382 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-79b7988b-7b2a-4588-a511-a383487ccd35 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: 0a2aa4b1-2fd2-45e4-a058-71f0855e48c0] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:02:38.962614 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-db1c2e13-b3f6-4c7e-8f49-4212c0717ebd tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:38.963083 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-79b7988b-7b2a-4588-a511-a383487ccd35 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:38.963203 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-db1c2e13-b3f6-4c7e-8f49-4212c0717ebd tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:38.963519 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-79b7988b-7b2a-4588-a511-a383487ccd35 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:38.963979 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-db1c2e13-b3f6-4c7e-8f49-4212c0717ebd tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:38.964280 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-79b7988b-7b2a-4588-a511-a383487ccd35 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:38.964416 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-db1c2e13-b3f6-4c7e-8f49-4212c0717ebd tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:38.964718 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-79b7988b-7b2a-4588-a511-a383487ccd35 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:38.968639 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=100 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:02:39.095447 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-79b7988b-7b2a-4588-a511-a383487ccd35 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8abb58f9c274e568d2d0fe3d4df11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01500cb03c74d1082090cd1c1836169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:02:39.099812 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-db1c2e13-b3f6-4c7e-8f49-4212c0717ebd tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:02:39.103757 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-79b7988b-7b2a-4588-a511-a383487ccd35 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/0a2aa4b1-2fd2-45e4-a058-71f0855e48c0" status: 200 len: 1366 microversion: 2.1 time: 0.151846 Jul 30 05:02:39.104325 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 328/688] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:02:38 2022] GET /compute/v2.1/servers/0a2aa4b1-2fd2-45e4-a058-71f0855e48c0 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 05:02:39.107571 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-db1c2e13-b3f6-4c7e-8f49-4212c0717ebd tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/65b7a5ff-be03-4f45-941c-26a50cdabf02" status: 200 len: 1721 microversion: 2.1 time: 0.156087 Jul 30 05:02:39.108125 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 361/689] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:02:38 2022] GET /compute/v2.1/servers/65b7a5ff-be03-4f45-941c-26a50cdabf02 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:02:40.126098 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-2075dbdf-f4e3-4f62-8ea2-a6e37d632378 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:02:40.126737 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-2075dbdf-f4e3-4f62-8ea2-a6e37d632378 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: 0a2aa4b1-2fd2-45e4-a058-71f0855e48c0] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:02:40.129487 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-496dcb3e-e2d8-457c-b4d8-c162a0904518 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:02:40.130046 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-496dcb3e-e2d8-457c-b4d8-c162a0904518 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 65b7a5ff-be03-4f45-941c-26a50cdabf02] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:02:40.130183 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:02:40.136909 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-496dcb3e-e2d8-457c-b4d8-c162a0904518 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:40.137104 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2075dbdf-f4e3-4f62-8ea2-a6e37d632378 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:40.137401 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-496dcb3e-e2d8-457c-b4d8-c162a0904518 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:40.137538 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2075dbdf-f4e3-4f62-8ea2-a6e37d632378 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:40.138186 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-496dcb3e-e2d8-457c-b4d8-c162a0904518 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:40.138419 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2075dbdf-f4e3-4f62-8ea2-a6e37d632378 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:40.138654 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-496dcb3e-e2d8-457c-b4d8-c162a0904518 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:40.138912 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2075dbdf-f4e3-4f62-8ea2-a6e37d632378 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:40.271794 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-496dcb3e-e2d8-457c-b4d8-c162a0904518 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:02:40.274722 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-2075dbdf-f4e3-4f62-8ea2-a6e37d632378 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8abb58f9c274e568d2d0fe3d4df11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01500cb03c74d1082090cd1c1836169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:02:40.279941 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-496dcb3e-e2d8-457c-b4d8-c162a0904518 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/65b7a5ff-be03-4f45-941c-26a50cdabf02" status: 200 len: 1721 microversion: 2.1 time: 0.154846 Jul 30 05:02:40.280516 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 362/690] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:02:40 2022] GET /compute/v2.1/servers/65b7a5ff-be03-4f45-941c-26a50cdabf02 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 05:02:40.281914 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-2075dbdf-f4e3-4f62-8ea2-a6e37d632378 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/0a2aa4b1-2fd2-45e4-a058-71f0855e48c0" status: 200 len: 1366 microversion: 2.1 time: 0.160291 Jul 30 05:02:40.282488 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 329/691] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:02:40 2022] GET /compute/v2.1/servers/0a2aa4b1-2fd2-45e4-a058-71f0855e48c0 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:02:41.302379 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-37108512-f56c-4572-ade1-33b9d01da005 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:02:41.303050 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-37108512-f56c-4572-ade1-33b9d01da005 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 65b7a5ff-be03-4f45-941c-26a50cdabf02] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:02:41.304000 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-f3f6b120-e589-47bb-9ba7-b07fcd89d589 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:02:41.304628 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-f3f6b120-e589-47bb-9ba7-b07fcd89d589 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: 0a2aa4b1-2fd2-45e4-a058-71f0855e48c0] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:02:41.309903 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-37108512-f56c-4572-ade1-33b9d01da005 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:41.310375 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-37108512-f56c-4572-ade1-33b9d01da005 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:41.311166 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-37108512-f56c-4572-ade1-33b9d01da005 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:41.311270 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f3f6b120-e589-47bb-9ba7-b07fcd89d589 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:41.311613 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-37108512-f56c-4572-ade1-33b9d01da005 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:41.311743 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f3f6b120-e589-47bb-9ba7-b07fcd89d589 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:41.312427 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f3f6b120-e589-47bb-9ba7-b07fcd89d589 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:41.312905 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f3f6b120-e589-47bb-9ba7-b07fcd89d589 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:41.447563 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-37108512-f56c-4572-ade1-33b9d01da005 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:02:41.448852 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-f3f6b120-e589-47bb-9ba7-b07fcd89d589 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8abb58f9c274e568d2d0fe3d4df11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01500cb03c74d1082090cd1c1836169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:02:41.455449 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-37108512-f56c-4572-ade1-33b9d01da005 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/65b7a5ff-be03-4f45-941c-26a50cdabf02" status: 200 len: 1727 microversion: 2.1 time: 0.157699 Jul 30 05:02:41.456009 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 363/692] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:02:41 2022] GET /compute/v2.1/servers/65b7a5ff-be03-4f45-941c-26a50cdabf02 => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:02:41.456532 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-f3f6b120-e589-47bb-9ba7-b07fcd89d589 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/0a2aa4b1-2fd2-45e4-a058-71f0855e48c0" status: 200 len: 1555 microversion: 2.1 time: 0.157312 Jul 30 05:02:41.457258 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 330/693] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:02:41 2022] GET /compute/v2.1/servers/0a2aa4b1-2fd2-45e4-a058-71f0855e48c0 => generated 1555 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 05:02:41.477224 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-dbc33700-ba3a-4388-92c7-f3f6a3e649d0 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:02:41.477409 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-c8709a71-3c7b-4595-b139-da64eb9224f4 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:02:41.477710 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-dbc33700-ba3a-4388-92c7-f3f6a3e649d0 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: 0a2aa4b1-2fd2-45e4-a058-71f0855e48c0] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:02:41.477823 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-c8709a71-3c7b-4595-b139-da64eb9224f4 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 65b7a5ff-be03-4f45-941c-26a50cdabf02] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:02:41.483736 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c8709a71-3c7b-4595-b139-da64eb9224f4 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:41.483890 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-dbc33700-ba3a-4388-92c7-f3f6a3e649d0 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:41.484180 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-dbc33700-ba3a-4388-92c7-f3f6a3e649d0 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:41.484298 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c8709a71-3c7b-4595-b139-da64eb9224f4 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:41.484933 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-dbc33700-ba3a-4388-92c7-f3f6a3e649d0 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:41.485043 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c8709a71-3c7b-4595-b139-da64eb9224f4 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:41.485360 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-dbc33700-ba3a-4388-92c7-f3f6a3e649d0 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:41.485458 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c8709a71-3c7b-4595-b139-da64eb9224f4 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:41.566945 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-c8709a71-3c7b-4595-b139-da64eb9224f4 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/65b7a5ff-be03-4f45-941c-26a50cdabf02/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093540 Jul 30 05:02:41.567558 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 331/694] 10.222.0.20 () {58 vars in 1275 bytes} [Sat Jul 30 05:02:41 2022] GET /compute/v2.1/servers/65b7a5ff-be03-4f45-941c-26a50cdabf02/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 05:02:41.568301 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-dbc33700-ba3a-4388-92c7-f3f6a3e649d0 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/0a2aa4b1-2fd2-45e4-a058-71f0855e48c0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095493 Jul 30 05:02:41.568908 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 364/695] 10.222.0.20 () {58 vars in 1275 bytes} [Sat Jul 30 05:02:41 2022] GET /compute/v2.1/servers/0a2aa4b1-2fd2-45e4-a058-71f0855e48c0/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 05:02:42.758066 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-bdec5ed6-c347-4bd9-a2d8-f9510dacee63 req-195f1cff-7ad8-444c-88cc-5cede3a0802c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65b7a5ff-be03-4f45-941c-26a50cdabf02", "tag": "3ee72598-16cb-4e6d-aa46-89dd6f7ad946"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:02:42.772363 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-bdec5ed6-c347-4bd9-a2d8-f9510dacee63 req-195f1cff-7ad8-444c-88cc-5cede3a0802c service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:42.779024 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-bdec5ed6-c347-4bd9-a2d8-f9510dacee63 req-195f1cff-7ad8-444c-88cc-5cede3a0802c service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:42.801325 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-bdec5ed6-c347-4bd9-a2d8-f9510dacee63 req-195f1cff-7ad8-444c-88cc-5cede3a0802c service nova] Creating event network-changed:3ee72598-16cb-4e6d-aa46-89dd6f7ad946 for instance 65b7a5ff-be03-4f45-941c-26a50cdabf02 on hv-cinder-85127 Jul 30 05:02:42.806557 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-bdec5ed6-c347-4bd9-a2d8-f9510dacee63 req-195f1cff-7ad8-444c-88cc-5cede3a0802c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052160 Jul 30 05:02:42.807394 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 332/696] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Jul 30 05:02:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 05:02:42.935266 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-21875d0c-86ff-418e-9476-b1a9445f015e req-50dcef9c-f9cc-40f7-853f-3be7a1c36363 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a2aa4b1-2fd2-45e4-a058-71f0855e48c0", "tag": "be23179b-b7b9-4f47-bb71-6ace62d54931"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:02:42.946472 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-21875d0c-86ff-418e-9476-b1a9445f015e req-50dcef9c-f9cc-40f7-853f-3be7a1c36363 service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:42.947168 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-21875d0c-86ff-418e-9476-b1a9445f015e req-50dcef9c-f9cc-40f7-853f-3be7a1c36363 service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:42.959360 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-21875d0c-86ff-418e-9476-b1a9445f015e req-50dcef9c-f9cc-40f7-853f-3be7a1c36363 service nova] Creating event network-changed:be23179b-b7b9-4f47-bb71-6ace62d54931 for instance 0a2aa4b1-2fd2-45e4-a058-71f0855e48c0 on hv-cinder-85127 Jul 30 05:02:42.969312 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-21875d0c-86ff-418e-9476-b1a9445f015e req-50dcef9c-f9cc-40f7-853f-3be7a1c36363 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037743 Jul 30 05:02:42.970297 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 365/697] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Jul 30 05:02:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 05:02:43.245873 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-0448a130-34b7-4e0d-9623-f61317962df4 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:02:43.246927 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-0448a130-34b7-4e0d-9623-f61317962df4 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] [instance: 366ac5bd-e8b9-46b5-8df3-509c48982078] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:02:43.255193 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0448a130-34b7-4e0d-9623-f61317962df4 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:43.255919 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0448a130-34b7-4e0d-9623-f61317962df4 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:43.257046 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0448a130-34b7-4e0d-9623-f61317962df4 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:43.257654 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0448a130-34b7-4e0d-9623-f61317962df4 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:43.357202 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.objects.instance [None req-0448a130-34b7-4e0d-9623-f61317962df4 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lazy-loading 'services' on Instance uuid 366ac5bd-e8b9-46b5-8df3-509c48982078 {{(pid=117885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 05:02:43.446485 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-0448a130-34b7-4e0d-9623-f61317962df4 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] 10.222.0.20 "DELETE /compute/v2.1/servers/366ac5bd-e8b9-46b5-8df3-509c48982078/os-volume_attachments/079c208c-70c1-4409-8e6e-7102ce54124b" status: 202 len: 0 microversion: 2.1 time: 0.204889 Jul 30 05:02:43.447848 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 333/698] 10.222.0.20 () {58 vars in 1416 bytes} [Sat Jul 30 05:02:43 2022] DELETE /compute/v2.1/servers/366ac5bd-e8b9-46b5-8df3-509c48982078/os-volume_attachments/079c208c-70c1-4409-8e6e-7102ce54124b => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 05:02:44.591621 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-0ec71915-1eee-428c-b779-64a967978d55 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:02:44.592198 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-0ec71915-1eee-428c-b779-64a967978d55 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] [instance: 366ac5bd-e8b9-46b5-8df3-509c48982078] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:02:44.594092 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:02:44.599846 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0ec71915-1eee-428c-b779-64a967978d55 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:44.600288 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0ec71915-1eee-428c-b779-64a967978d55 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:44.601038 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0ec71915-1eee-428c-b779-64a967978d55 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:44.601467 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0ec71915-1eee-428c-b779-64a967978d55 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:44.626979 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-0ec71915-1eee-428c-b779-64a967978d55 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] [instance: 366ac5bd-e8b9-46b5-8df3-509c48982078] Going to try to terminate instance {{(pid=117886) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 05:02:44.703628 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-0ec71915-1eee-428c-b779-64a967978d55 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] 10.222.0.20 "DELETE /compute/v2.1/servers/366ac5bd-e8b9-46b5-8df3-509c48982078" status: 204 len: 0 microversion: 2.1 time: 0.116297 Jul 30 05:02:44.704422 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 366/699] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Jul 30 05:02:44 2022] DELETE /compute/v2.1/servers/366ac5bd-e8b9-46b5-8df3-509c48982078 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 05:02:44.714371 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-80efb4f0-b6e6-495a-9b6d-6a4a327001d3 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:02:44.715102 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-80efb4f0-b6e6-495a-9b6d-6a4a327001d3 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] [instance: 366ac5bd-e8b9-46b5-8df3-509c48982078] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:02:44.721873 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-80efb4f0-b6e6-495a-9b6d-6a4a327001d3 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:44.722781 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-80efb4f0-b6e6-495a-9b6d-6a4a327001d3 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:44.723675 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-80efb4f0-b6e6-495a-9b6d-6a4a327001d3 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:44.724121 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-80efb4f0-b6e6-495a-9b6d-6a4a327001d3 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:44.823325 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-d8648e55-a5eb-48fa-9e55-48cd5e9c99a5 req-5abfe61f-5775-4814-b85e-f7187c1f040a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65b7a5ff-be03-4f45-941c-26a50cdabf02", "tag": "3ee72598-16cb-4e6d-aa46-89dd6f7ad946"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:02:44.832656 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-d8648e55-a5eb-48fa-9e55-48cd5e9c99a5 req-5abfe61f-5775-4814-b85e-f7187c1f040a service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:44.833100 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-d8648e55-a5eb-48fa-9e55-48cd5e9c99a5 req-5abfe61f-5775-4814-b85e-f7187c1f040a service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:44.844989 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-d8648e55-a5eb-48fa-9e55-48cd5e9c99a5 req-5abfe61f-5775-4814-b85e-f7187c1f040a service nova] Creating event network-changed:3ee72598-16cb-4e6d-aa46-89dd6f7ad946 for instance 65b7a5ff-be03-4f45-941c-26a50cdabf02 on hv-cinder-85127 Jul 30 05:02:44.850043 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-d8648e55-a5eb-48fa-9e55-48cd5e9c99a5 req-5abfe61f-5775-4814-b85e-f7187c1f040a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030760 Jul 30 05:02:44.850667 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 367/700] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Jul 30 05:02:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 05:02:44.854990 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-80efb4f0-b6e6-495a-9b6d-6a4a327001d3 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334f2d8d9d9a4f7a90586999398f8a40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a02f6df4ed4365b3ce1fa970f9cf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:02:44.862516 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-80efb4f0-b6e6-495a-9b6d-6a4a327001d3 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] 10.222.0.20 "GET /compute/v2.1/servers/366ac5bd-e8b9-46b5-8df3-509c48982078" status: 200 len: 1512 microversion: 2.1 time: 0.152370 Jul 30 05:02:44.863767 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 334/701] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:02:44 2022] GET /compute/v2.1/servers/366ac5bd-e8b9-46b5-8df3-509c48982078 => generated 1512 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:02:45.884965 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-ed26f88c-4944-4261-812c-3e0daac785e4 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:02:45.885655 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-ed26f88c-4944-4261-812c-3e0daac785e4 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] [instance: 366ac5bd-e8b9-46b5-8df3-509c48982078] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:02:45.891900 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ed26f88c-4944-4261-812c-3e0daac785e4 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:45.892343 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ed26f88c-4944-4261-812c-3e0daac785e4 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:45.893127 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ed26f88c-4944-4261-812c-3e0daac785e4 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:45.893559 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ed26f88c-4944-4261-812c-3e0daac785e4 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:46.026695 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-ed26f88c-4944-4261-812c-3e0daac785e4 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334f2d8d9d9a4f7a90586999398f8a40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a02f6df4ed4365b3ce1fa970f9cf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:02:46.034193 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-ed26f88c-4944-4261-812c-3e0daac785e4 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] 10.222.0.20 "GET /compute/v2.1/servers/366ac5bd-e8b9-46b5-8df3-509c48982078" status: 200 len: 1512 microversion: 2.1 time: 0.153841 Jul 30 05:02:46.035298 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 368/702] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:02:45 2022] GET /compute/v2.1/servers/366ac5bd-e8b9-46b5-8df3-509c48982078 => generated 1512 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:02:47.056388 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-dbce8a8a-3d35-4c28-99af-0214379237e5 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:02:47.057083 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-dbce8a8a-3d35-4c28-99af-0214379237e5 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] [instance: 366ac5bd-e8b9-46b5-8df3-509c48982078] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:02:47.063778 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-dbce8a8a-3d35-4c28-99af-0214379237e5 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:47.064231 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-dbce8a8a-3d35-4c28-99af-0214379237e5 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:47.065006 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-dbce8a8a-3d35-4c28-99af-0214379237e5 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:47.065442 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-dbce8a8a-3d35-4c28-99af-0214379237e5 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:47.285653 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-dbce8a8a-3d35-4c28-99af-0214379237e5 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334f2d8d9d9a4f7a90586999398f8a40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a02f6df4ed4365b3ce1fa970f9cf41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:02:47.293033 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-dbce8a8a-3d35-4c28-99af-0214379237e5 tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] 10.222.0.20 "GET /compute/v2.1/servers/366ac5bd-e8b9-46b5-8df3-509c48982078" status: 200 len: 1512 microversion: 2.1 time: 0.240582 Jul 30 05:02:47.293597 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 335/703] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:02:47 2022] GET /compute/v2.1/servers/366ac5bd-e8b9-46b5-8df3-509c48982078 => generated 1512 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:02:47.337738 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-a2ffb0d7-5288-4794-89dc-a5056db63151 req-5b4faf99-032c-4d7e-baff-62ace1da83fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "366ac5bd-e8b9-46b5-8df3-509c48982078", "name": "network-vif-deleted", "tag": "a0185df1-915f-4d83-8e9a-39b3098f5156"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:02:47.348396 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-a2ffb0d7-5288-4794-89dc-a5056db63151 req-5b4faf99-032c-4d7e-baff-62ace1da83fb service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:47.348938 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-a2ffb0d7-5288-4794-89dc-a5056db63151 req-5b4faf99-032c-4d7e-baff-62ace1da83fb service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:47.360097 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-a2ffb0d7-5288-4794-89dc-a5056db63151 req-5b4faf99-032c-4d7e-baff-62ace1da83fb service nova] Creating event network-vif-deleted:a0185df1-915f-4d83-8e9a-39b3098f5156 for instance 366ac5bd-e8b9-46b5-8df3-509c48982078 on hv-cinder-85127 Jul 30 05:02:47.365327 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-a2ffb0d7-5288-4794-89dc-a5056db63151 req-5b4faf99-032c-4d7e-baff-62ace1da83fb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031144 Jul 30 05:02:47.365920 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 369/704] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Jul 30 05:02:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 05:02:48.315039 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-dd080119-ff70-4bf4-94c4-4a41aafb70ea tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:02:48.315584 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-dd080119-ff70-4bf4-94c4-4a41aafb70ea tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] [instance: 366ac5bd-e8b9-46b5-8df3-509c48982078] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:02:48.322592 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-dd080119-ff70-4bf4-94c4-4a41aafb70ea tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:48.323051 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-dd080119-ff70-4bf4-94c4-4a41aafb70ea tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:48.323820 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-dd080119-ff70-4bf4-94c4-4a41aafb70ea tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:02:48.324265 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-dd080119-ff70-4bf4-94c4-4a41aafb70ea tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:02:48.338104 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.wsgi [None req-dd080119-ff70-4bf4-94c4-4a41aafb70ea tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] HTTP exception thrown: Instance 366ac5bd-e8b9-46b5-8df3-509c48982078 could not be found. Jul 30 05:02:48.339793 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-dd080119-ff70-4bf4-94c4-4a41aafb70ea tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Request method failure captured: Jul 30 05:02:48.339793 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: request: GET /compute/v2.1/servers/366ac5bd-e8b9-46b5-8df3-509c48982078 HTTP/1.1 Jul 30 05:02:48.339793 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Accept: application/json Jul 30 05:02:48.339793 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Accept-Encoding: identity Jul 30 05:02:48.339793 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Connection: close Jul 30 05:02:48.339793 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Content-Length: 0 Jul 30 05:02:48.339793 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Content-Type: application/json Jul 30 05:02:48.339793 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Host: 10.222.0.20 Jul 30 05:02:48.339793 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Openstack-System-Scope: None Jul 30 05:02:48.339793 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: User-Agent: python-urllib3/1.26.10 Jul 30 05:02:48.339793 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Auth-Token: gAAAAABi5Lrm9FZsrUOAsTeBfld8u4OciBEK5QiQywF6Zh6BUEe3qrnBNy8P-yM6Vv9fynfUSwn-IdQR7erkPA2b3Ffp9HhiQipqchvi9YTJCF3mKWvyu8L3ttC80Fe5oGlsrLYTYTUc5P9TlAvO9s2ieDGZTqpqHnbohUPMN2_5bQuT9D58V6Y Jul 30 05:02:48.339793 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Domain-Id: None Jul 30 05:02:48.339793 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Domain-Name: None Jul 30 05:02:48.339793 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Identity-Status: Confirmed Jul 30 05:02:48.339793 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Is-Admin-Project: True Jul 30 05:02:48.339793 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Domain-Id: default Jul 30 05:02:48.339793 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Domain-Name: Default Jul 30 05:02:48.339793 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Id: a6a02f6df4ed4365b3ce1fa970f9cf41 Jul 30 05:02:48.339793 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1525543449 Jul 30 05:02:48.339793 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Role: member,reader Jul 30 05:02:48.339793 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Roles: member,reader Jul 30 05:02:48.341381 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a6a02f6df4ed4365b3ce1fa970f9cf41"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a6a02f6df4ed4365b3ce1fa970f9cf41"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a6a02f6df4ed4365b3ce1fa970f9cf41"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a6a02f6df4ed4365b3ce1fa970f9cf41"}]}] Jul 30 05:02:48.341381 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Tenant: tempest-VolumesSnapshotTestJSON-1525543449 Jul 30 05:02:48.341381 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Tenant-Id: a6a02f6df4ed4365b3ce1fa970f9cf41 Jul 30 05:02:48.341381 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1525543449 Jul 30 05:02:48.341381 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User: tempest-VolumesSnapshotTestJSON-1525543449-project Jul 30 05:02:48.341381 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Domain-Id: default Jul 30 05:02:48.341381 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Domain-Name: Default Jul 30 05:02:48.341381 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Id: 334f2d8d9d9a4f7a90586999398f8a40 Jul 30 05:02:48.341381 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Name: tempest-VolumesSnapshotTestJSON-1525543449-project Jul 30 05:02:48.341381 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: method: > Jul 30 05:02:48.341381 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: exception: Instance 366ac5bd-e8b9-46b5-8df3-509c48982078 could not be found. Jul 30 05:02:48.341381 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: action_args: {'id': '366ac5bd-e8b9-46b5-8df3-509c48982078'} Jul 30 05:02:48.342305 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 05:02:48.342305 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:02:48.342305 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 05:02:48.342305 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 05:02:48.342305 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 05:02:48.342305 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 05:02:48.342305 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 05:02:48.342305 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 05:02:48.342305 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 05:02:48.342305 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 05:02:48.342305 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 366ac5bd-e8b9-46b5-8df3-509c48982078 could not be found. Jul 30 05:02:48.342305 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:02:48.342305 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 05:02:48.342305 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:02:48.342305 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:02:48.342305 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 05:02:48.342305 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 05:02:48.342305 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 05:02:48.342305 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 05:02:48.342305 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 05:02:48.343830 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 05:02:48.343830 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 05:02:48.343830 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 05:02:48.343830 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 05:02:48.343830 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 05:02:48.343830 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 05:02:48.343830 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 05:02:48.343830 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 366ac5bd-e8b9-46b5-8df3-509c48982078 could not be found. Jul 30 05:02:48.343830 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:02:48.343830 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 05:02:48.343830 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:02:48.343830 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:02:48.343830 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 05:02:48.343830 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 05:02:48.343830 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 05:02:48.343830 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 05:02:48.343830 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 366ac5bd-e8b9-46b5-8df3-509c48982078 could not be found. Jul 30 05:02:48.343830 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:02:48.345321 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-dd080119-ff70-4bf4-94c4-4a41aafb70ea tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] Returning 404 to user: Instance 366ac5bd-e8b9-46b5-8df3-509c48982078 could not be found. {{(pid=117885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 05:02:48.345321 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-dd080119-ff70-4bf4-94c4-4a41aafb70ea tempest-VolumesSnapshotTestJSON-1525543449 tempest-VolumesSnapshotTestJSON-1525543449-project] 10.222.0.20 "GET /compute/v2.1/servers/366ac5bd-e8b9-46b5-8df3-509c48982078" status: 404 len: 111 microversion: 2.1 time: 0.030157 Jul 30 05:02:48.345321 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 336/705] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:02:48 2022] GET /compute/v2.1/servers/366ac5bd-e8b9-46b5-8df3-509c48982078 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 05:03:00.032310 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_api:SELECT=12,nova_api:UPDATE=1 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:03:00.033083 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:03:00.037936 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-2d3f8ccf-4777-4cb2-ab34-5aa802c66aa8 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:00.038550 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-2d3f8ccf-4777-4cb2-ab34-5aa802c66aa8 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:00.046700 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2d3f8ccf-4777-4cb2-ab34-5aa802c66aa8 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:00.047152 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2d3f8ccf-4777-4cb2-ab34-5aa802c66aa8 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:00.047916 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2d3f8ccf-4777-4cb2-ab34-5aa802c66aa8 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:00.048354 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2d3f8ccf-4777-4cb2-ab34-5aa802c66aa8 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:00.077607 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-2d3f8ccf-4777-4cb2-ab34-5aa802c66aa8 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229/os-volume_attachments/51865069-d6f2-4955-924b-bf9d31edae15" status: 200 len: 194 microversion: 2.20 time: 0.046949 Jul 30 05:03:00.078191 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 370/706] 10.222.0.20 () {60 vars in 1454 bytes} [Sat Jul 30 05:03:00 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229/os-volume_attachments/51865069-d6f2-4955-924b-bf9d31edae15 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 05:03:00.146129 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-8e9352a4-49fb-4dca-8ed7-510be3a34662 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:00.146665 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-8e9352a4-49fb-4dca-8ed7-510be3a34662 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:00.149042 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_api:SELECT=15 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:03:00.149696 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell1:SELECT=63,nova_cell1:INSERT=1 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:03:00.155653 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8e9352a4-49fb-4dca-8ed7-510be3a34662 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:00.156110 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8e9352a4-49fb-4dca-8ed7-510be3a34662 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:00.156885 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8e9352a4-49fb-4dca-8ed7-510be3a34662 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:00.157331 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8e9352a4-49fb-4dca-8ed7-510be3a34662 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:00.237957 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.objects.instance [None req-8e9352a4-49fb-4dca-8ed7-510be3a34662 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lazy-loading 'services' on Instance uuid e4370e65-bec4-454f-9566-33ff60441229 {{(pid=117885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 05:03:00.309854 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-8e9352a4-49fb-4dca-8ed7-510be3a34662 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229/os-volume_attachments/51865069-d6f2-4955-924b-bf9d31edae15" status: 202 len: 0 microversion: 2.20 time: 0.168049 Jul 30 05:03:00.310763 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 337/707] 10.222.0.20 () {60 vars in 1457 bytes} [Sat Jul 30 05:03:00 2022] DELETE /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229/os-volume_attachments/51865069-d6f2-4955-924b-bf9d31edae15 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 30 05:03:00.319751 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-ea1915b9-6448-4e4a-b705-bafff1cd60ba tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:00.321884 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-ea1915b9-6448-4e4a-b705-bafff1cd60ba tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:00.327851 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ea1915b9-6448-4e4a-b705-bafff1cd60ba tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:00.328276 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ea1915b9-6448-4e4a-b705-bafff1cd60ba tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:00.329142 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ea1915b9-6448-4e4a-b705-bafff1cd60ba tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:00.329470 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ea1915b9-6448-4e4a-b705-bafff1cd60ba tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:00.359084 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-ea1915b9-6448-4e4a-b705-bafff1cd60ba tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043833 Jul 30 05:03:00.359634 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 371/708] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Jul 30 05:03:00 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 05:03:01.372266 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-d6f8b9d4-7f9a-4d68-977a-d6965307c86f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:01.374660 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-d6f8b9d4-7f9a-4d68-977a-d6965307c86f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:01.382279 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d6f8b9d4-7f9a-4d68-977a-d6965307c86f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:01.382759 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d6f8b9d4-7f9a-4d68-977a-d6965307c86f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:01.383513 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d6f8b9d4-7f9a-4d68-977a-d6965307c86f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:01.383948 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d6f8b9d4-7f9a-4d68-977a-d6965307c86f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:01.415675 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-d6f8b9d4-7f9a-4d68-977a-d6965307c86f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047830 Jul 30 05:03:01.416250 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 338/709] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Jul 30 05:03:01 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:03:01.477618 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-98d7899b-1967-4f3b-99d4-fd31972f6964 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:01.478117 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-98d7899b-1967-4f3b-99d4-fd31972f6964 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:01.484523 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-98d7899b-1967-4f3b-99d4-fd31972f6964 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:01.485052 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-98d7899b-1967-4f3b-99d4-fd31972f6964 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:01.485939 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-98d7899b-1967-4f3b-99d4-fd31972f6964 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:01.486383 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-98d7899b-1967-4f3b-99d4-fd31972f6964 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:01.513364 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-98d7899b-1967-4f3b-99d4-fd31972f6964 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Going to try to terminate instance {{(pid=117886) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 05:03:01.585741 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-98d7899b-1967-4f3b-99d4-fd31972f6964 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 204 len: 0 microversion: 2.20 time: 0.111769 Jul 30 05:03:01.586325 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 372/710] 10.222.0.20 () {60 vars in 1280 bytes} [Sat Jul 30 05:03:01 2022] DELETE /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 30 05:03:01.595262 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-27b1864b-0ff4-4550-86cc-8599f81726df tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:01.595871 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-27b1864b-0ff4-4550-86cc-8599f81726df tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:01.602589 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-27b1864b-0ff4-4550-86cc-8599f81726df tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:01.603037 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-27b1864b-0ff4-4550-86cc-8599f81726df tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:01.603794 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-27b1864b-0ff4-4550-86cc-8599f81726df tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:01.604227 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-27b1864b-0ff4-4550-86cc-8599f81726df tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:01.733147 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-27b1864b-0ff4-4550-86cc-8599f81726df tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:01.741843 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-27b1864b-0ff4-4550-86cc-8599f81726df tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:01.743407 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-27b1864b-0ff4-4550-86cc-8599f81726df tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:01.744692 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-27b1864b-0ff4-4550-86cc-8599f81726df tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1723 microversion: 2.20 time: 0.153320 Jul 30 05:03:01.745291 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 339/711] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:03:01 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 05:03:02.767994 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-bc10695e-2e27-4fbb-8a27-9e68412fe5d7 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:02.768807 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-bc10695e-2e27-4fbb-8a27-9e68412fe5d7 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:02.774783 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bc10695e-2e27-4fbb-8a27-9e68412fe5d7 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:02.775236 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bc10695e-2e27-4fbb-8a27-9e68412fe5d7 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:02.775995 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bc10695e-2e27-4fbb-8a27-9e68412fe5d7 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:02.776425 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bc10695e-2e27-4fbb-8a27-9e68412fe5d7 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:02.912610 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-bc10695e-2e27-4fbb-8a27-9e68412fe5d7 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:02.920716 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-bc10695e-2e27-4fbb-8a27-9e68412fe5d7 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:02.922206 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-bc10695e-2e27-4fbb-8a27-9e68412fe5d7 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:02.923450 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-bc10695e-2e27-4fbb-8a27-9e68412fe5d7 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1723 microversion: 2.20 time: 0.159887 Jul 30 05:03:02.924000 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 373/712] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:03:02 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 05:03:03.947335 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-c4eb32c1-5073-4343-9a5f-4ea8ec4ac318 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:03.947880 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-c4eb32c1-5073-4343-9a5f-4ea8ec4ac318 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:03.955620 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c4eb32c1-5073-4343-9a5f-4ea8ec4ac318 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:03.956618 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c4eb32c1-5073-4343-9a5f-4ea8ec4ac318 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:03.957395 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c4eb32c1-5073-4343-9a5f-4ea8ec4ac318 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:03.957818 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c4eb32c1-5073-4343-9a5f-4ea8ec4ac318 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:04.045267 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-c4eb32c1-5073-4343-9a5f-4ea8ec4ac318 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:04.053561 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-c4eb32c1-5073-4343-9a5f-4ea8ec4ac318 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:04.055094 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-c4eb32c1-5073-4343-9a5f-4ea8ec4ac318 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:04.056255 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-c4eb32c1-5073-4343-9a5f-4ea8ec4ac318 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 200 len: 1655 microversion: 2.20 time: 0.112982 Jul 30 05:03:04.056809 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 340/713] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:03:03 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 1655 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 05:03:04.266387 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-2056716d-f4b5-4890-a29d-7fad4cb50338 req-0dbcee64-ca11-4976-8f49-786634076c3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4370e65-bec4-454f-9566-33ff60441229", "name": "network-vif-deleted", "tag": "77f9d403-dee8-430d-8122-9a468f943da2"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:03:04.278061 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-2056716d-f4b5-4890-a29d-7fad4cb50338 req-0dbcee64-ca11-4976-8f49-786634076c3d service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:04.278927 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-2056716d-f4b5-4890-a29d-7fad4cb50338 req-0dbcee64-ca11-4976-8f49-786634076c3d service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:04.292178 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-2056716d-f4b5-4890-a29d-7fad4cb50338 req-0dbcee64-ca11-4976-8f49-786634076c3d service nova] Creating event network-vif-deleted:77f9d403-dee8-430d-8122-9a468f943da2 for instance e4370e65-bec4-454f-9566-33ff60441229 on hv-cinder-85127 Jul 30 05:03:04.297765 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-2056716d-f4b5-4890-a29d-7fad4cb50338 req-0dbcee64-ca11-4976-8f49-786634076c3d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034957 Jul 30 05:03:04.298274 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 374/714] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Jul 30 05:03:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 05:03:05.079593 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-1cd1a240-1203-4e43-9373-e28882f96971 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:05.080228 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-1cd1a240-1203-4e43-9373-e28882f96971 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:05.087880 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1cd1a240-1203-4e43-9373-e28882f96971 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:05.088396 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1cd1a240-1203-4e43-9373-e28882f96971 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:05.089236 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1cd1a240-1203-4e43-9373-e28882f96971 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:05.089788 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1cd1a240-1203-4e43-9373-e28882f96971 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:05.104811 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.wsgi [None req-1cd1a240-1203-4e43-9373-e28882f96971 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] HTTP exception thrown: Instance e4370e65-bec4-454f-9566-33ff60441229 could not be found. Jul 30 05:03:05.106513 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-1cd1a240-1203-4e43-9373-e28882f96971 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Request method failure captured: Jul 30 05:03:05.106513 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: request: GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 HTTP/1.1 Jul 30 05:03:05.106513 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Accept: application/json Jul 30 05:03:05.106513 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Accept-Encoding: identity Jul 30 05:03:05.106513 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Connection: close Jul 30 05:03:05.106513 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Content-Length: 0 Jul 30 05:03:05.106513 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Content-Type: application/json Jul 30 05:03:05.106513 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Host: 10.222.0.20 Jul 30 05:03:05.106513 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Openstack-System-Scope: None Jul 30 05:03:05.106513 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: User-Agent: python-urllib3/1.26.10 Jul 30 05:03:05.106513 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Auth-Token: gAAAAABi5Lps1aYmuC12Yad7gE7AWSoKC92IYRluU7k6ePMSJV_5YZ_RF6tmLr7JLHaidp3snp7fO3IOYPrhHS4jpmzbSFUtIDlhdmzFr6Y0Y4ChpwG1lnSwznqLkHPDg6LX4U9ITCr11oprAilfxNOB1R_3WeHA0Os43SN5pjNxUgT8BOG34vY Jul 30 05:03:05.106513 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Domain-Id: None Jul 30 05:03:05.106513 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Domain-Name: None Jul 30 05:03:05.106513 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Identity-Status: Confirmed Jul 30 05:03:05.106513 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Is-Admin-Project: True Jul 30 05:03:05.106513 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Openstack-Nova-Api-Version: 2.20 Jul 30 05:03:05.106513 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Domain-Id: default Jul 30 05:03:05.106513 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Domain-Name: Default Jul 30 05:03:05.106513 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Id: bc6f8afc1abf427f92c44fdc55994b18 Jul 30 05:03:05.106513 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1684292964 Jul 30 05:03:05.106513 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Role: member,reader Jul 30 05:03:05.106513 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Roles: member,reader Jul 30 05:03:05.108145 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bc6f8afc1abf427f92c44fdc55994b18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bc6f8afc1abf427f92c44fdc55994b18"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_bc6f8afc1abf427f92c44fdc55994b18"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/bc6f8afc1abf427f92c44fdc55994b18"}]}] Jul 30 05:03:05.108145 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1684292964 Jul 30 05:03:05.108145 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Tenant-Id: bc6f8afc1abf427f92c44fdc55994b18 Jul 30 05:03:05.108145 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1684292964 Jul 30 05:03:05.108145 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User: tempest-AttachVolumeShelveTestJSON-1684292964-project Jul 30 05:03:05.108145 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Domain-Id: default Jul 30 05:03:05.108145 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Domain-Name: Default Jul 30 05:03:05.108145 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Id: d3a56c6d44b74429a6616cdfc2869b71 Jul 30 05:03:05.108145 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1684292964-project Jul 30 05:03:05.108145 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: method: > Jul 30 05:03:05.108145 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: exception: Instance e4370e65-bec4-454f-9566-33ff60441229 could not be found. Jul 30 05:03:05.108145 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: action_args: {'id': 'e4370e65-bec4-454f-9566-33ff60441229'} Jul 30 05:03:05.108999 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 05:03:05.108999 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:03:05.108999 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 05:03:05.108999 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 05:03:05.108999 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 05:03:05.108999 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 05:03:05.108999 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 05:03:05.108999 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 05:03:05.108999 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 05:03:05.108999 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 05:03:05.108999 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4370e65-bec4-454f-9566-33ff60441229 could not be found. Jul 30 05:03:05.108999 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:03:05.108999 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 05:03:05.108999 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:03:05.108999 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:03:05.108999 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 05:03:05.108999 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 05:03:05.108999 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 05:03:05.108999 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 05:03:05.108999 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 05:03:05.110259 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 05:03:05.110259 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 05:03:05.110259 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 05:03:05.110259 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 05:03:05.110259 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 05:03:05.110259 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 05:03:05.110259 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 05:03:05.110259 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4370e65-bec4-454f-9566-33ff60441229 could not be found. Jul 30 05:03:05.110259 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:03:05.110259 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 05:03:05.110259 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:03:05.110259 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:03:05.110259 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 05:03:05.110259 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 05:03:05.110259 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 05:03:05.110259 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 05:03:05.110259 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4370e65-bec4-454f-9566-33ff60441229 could not be found. Jul 30 05:03:05.110259 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:03:05.111433 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-1cd1a240-1203-4e43-9373-e28882f96971 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Returning 404 to user: Instance e4370e65-bec4-454f-9566-33ff60441229 could not be found. {{(pid=117885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 05:03:05.111433 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-1cd1a240-1203-4e43-9373-e28882f96971 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 404 len: 111 microversion: 2.20 time: 0.032550 Jul 30 05:03:05.111433 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 341/715] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:03:05 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 30 05:03:05.117355 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-79584655-968b-46c0-9205-2cd106767dfc tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '.version_select at 0x7f2db406a5e0>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:05.138840 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-79584655-968b-46c0-9205-2cd106767dfc tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1945790699" status: 204 len: 0 microversion: 2.20 time: 0.025470 Jul 30 05:03:05.139697 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 375/716] 10.222.0.20 () {60 vars in 1262 bytes} [Sat Jul 30 05:03:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1945790699 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 30 05:03:05.804206 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-4b9b1f8a-e843-413e-bf1a-0e5e297cfe4f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Action: 'create', calling method: .version_select at 0x7f2db4038310>, body: {"keypair": {"name": "tempest-keypair-1851664937", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE/vvGg/fNmloKhNeOoDaYIHLiuQP+o5zsY/4OK5Ot9otNg0Yi62OIVxpT1qqkitDOZ1NNtTRkqRmyompyL0q+8OE4GoVqdbvz89qJb0hWEUCChVBhVAx/GlKGbRgz+jlw=="}} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:03:05.819990 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.quota [None req-4b9b1f8a-e843-413e-bf1a-0e5e297cfe4f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Getting quotas for project bc6f8afc1abf427f92c44fdc55994b18. Resources: {'key_pairs'} {{(pid=117885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 05:03:05.823785 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.quota [None req-4b9b1f8a-e843-413e-bf1a-0e5e297cfe4f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Getting quotas for user d3a56c6d44b74429a6616cdfc2869b71 and project bc6f8afc1abf427f92c44fdc55994b18. Resources: {'key_pairs'} {{(pid=117885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 05:03:05.845327 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-4b9b1f8a-e843-413e-bf1a-0e5e297cfe4f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.045590 Jul 30 05:03:05.845917 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 342/717] 10.222.0.20 () {62 vars in 1200 bytes} [Sat Jul 30 05:03:05 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 47 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 30 05:03:07.055647 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-70a1ace8-09f8-4d96-a5c9-fe7ce678f3b4 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:03:07.056448 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-70a1ace8-09f8-4d96-a5c9-fe7ce678f3b4 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] [instance: 99b497c8-e641-428a-94b6-86c21af5844f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:07.063213 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-70a1ace8-09f8-4d96-a5c9-fe7ce678f3b4 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:07.063869 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-70a1ace8-09f8-4d96-a5c9-fe7ce678f3b4 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:07.064835 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-70a1ace8-09f8-4d96-a5c9-fe7ce678f3b4 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:07.065906 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-70a1ace8-09f8-4d96-a5c9-fe7ce678f3b4 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:07.098835 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.objects.instance [None req-70a1ace8-09f8-4d96-a5c9-fe7ce678f3b4 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lazy-loading 'flavor' on Instance uuid 99b497c8-e641-428a-94b6-86c21af5844f {{(pid=117886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 05:03:07.129141 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-543779e2-8678-4449-8e32-bbe4fc6e92d4 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1298035101", "imageRef": "d6a9c8e1-ecb9-4603-bb88-2b0d46ac2387", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fdf70601-7662-4f43-8ddd-db3bc3add8d1"}], "security_groups": [{"name": "tempest-securitygroup--1225094420"}], "key_name": "tempest-keypair-1851664937", "user_data": "}} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:03:07.187324 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-70a1ace8-09f8-4d96-a5c9-fe7ce678f3b4 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] 10.222.0.20 "POST /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f/action" status: 202 len: 0 microversion: 2.1 time: 0.136662 Jul 30 05:03:07.191751 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 376/718] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Jul 30 05:03:07 2022] POST /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 05:03:07.197166 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-baf85270-b024-47a0-9664-6aa01d71f3db tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:07.197874 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-baf85270-b024-47a0-9664-6aa01d71f3db tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] [instance: 99b497c8-e641-428a-94b6-86c21af5844f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:07.204207 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-baf85270-b024-47a0-9664-6aa01d71f3db tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:07.204647 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-baf85270-b024-47a0-9664-6aa01d71f3db tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:07.205466 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-baf85270-b024-47a0-9664-6aa01d71f3db tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:07.205994 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-baf85270-b024-47a0-9664-6aa01d71f3db tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:07.247729 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.network.neutron [None req-543779e2-8678-4449-8e32-bbe4fc6e92d4 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] validate_networks() for [('fdf70601-7662-4f43-8ddd-db3bc3add8d1', None, None, None, None, None)] {{(pid=117885) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 05:03:07.347526 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-baf85270-b024-47a0-9664-6aa01d71f3db tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a98edf8e5a4a22b3ae7d041b582b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76df23454a3c4a9bb4f61b044ed5a426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:07.356284 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-baf85270-b024-47a0-9664-6aa01d71f3db tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] 10.222.0.20 "GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f" status: 200 len: 1563 microversion: 2.1 time: 0.163109 Jul 30 05:03:07.356890 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 377/719] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:03:07 2022] GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f => generated 1563 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 05:03:07.850404 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-543779e2-8678-4449-8e32-bbe4fc6e92d4 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Flavor limits 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 05:03:07.850916 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-543779e2-8678-4449-8e32-bbe4fc6e92d4 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Image limits 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 05:03:07.851390 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-543779e2-8678-4449-8e32-bbe4fc6e92d4 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Flavor pref 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 05:03:07.851801 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-543779e2-8678-4449-8e32-bbe4fc6e92d4 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Image pref 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 05:03:07.852214 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-543779e2-8678-4449-8e32-bbe4fc6e92d4 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 05:03:07.860931 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-543779e2-8678-4449-8e32-bbe4fc6e92d4 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:07.861376 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-543779e2-8678-4449-8e32-bbe4fc6e92d4 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:07.862800 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-543779e2-8678-4449-8e32-bbe4fc6e92d4 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:07.863241 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-543779e2-8678-4449-8e32-bbe4fc6e92d4 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:07.879468 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.quota [None req-543779e2-8678-4449-8e32-bbe4fc6e92d4 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Getting quotas for project bc6f8afc1abf427f92c44fdc55994b18. Resources: {'ram', 'cores', 'instances'} {{(pid=117885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 05:03:07.883376 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.quota [None req-543779e2-8678-4449-8e32-bbe4fc6e92d4 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Getting quotas for user d3a56c6d44b74429a6616cdfc2869b71 and project bc6f8afc1abf427f92c44fdc55994b18. Resources: {'ram', 'cores', 'instances'} {{(pid=117885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 05:03:07.894713 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-543779e2-8678-4449-8e32-bbe4fc6e92d4 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Going to run 1 instances... {{(pid=117885) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 05:03:07.896921 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-543779e2-8678-4449-8e32-bbe4fc6e92d4 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d6a9c8e1-ecb9-4603-bb88-2b0d46ac2387',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 05:03:07.942090 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-543779e2-8678-4449-8e32-bbe4fc6e92d4 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.819152 Jul 30 05:03:07.942760 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 343/720] 10.222.0.20 () {62 vars in 1188 bytes} [Sat Jul 30 05:03:07 2022] POST /compute/v2.1/servers => generated 402 bytes in 820 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jul 30 05:03:07.953843 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-98eb91f7-9d45-47aa-b358-12bda57ca86b tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:07.954479 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-98eb91f7-9d45-47aa-b358-12bda57ca86b tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:08.009924 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-98eb91f7-9d45-47aa-b358-12bda57ca86b tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:08.017373 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-98eb91f7-9d45-47aa-b358-12bda57ca86b tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:08.019858 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-98eb91f7-9d45-47aa-b358-12bda57ca86b tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:08.020998 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-98eb91f7-9d45-47aa-b358-12bda57ca86b tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b" status: 200 len: 1282 microversion: 2.20 time: 0.071075 Jul 30 05:03:08.021749 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 378/721] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:03:07 2022] GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b => generated 1282 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 05:03:08.381389 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-5b2b1036-7889-4e94-b395-f2849b060839 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:08.382072 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-5b2b1036-7889-4e94-b395-f2849b060839 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] [instance: 99b497c8-e641-428a-94b6-86c21af5844f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:08.389446 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5b2b1036-7889-4e94-b395-f2849b060839 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:08.389970 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5b2b1036-7889-4e94-b395-f2849b060839 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:08.391037 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5b2b1036-7889-4e94-b395-f2849b060839 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:08.391494 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5b2b1036-7889-4e94-b395-f2849b060839 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:08.529689 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-5b2b1036-7889-4e94-b395-f2849b060839 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a98edf8e5a4a22b3ae7d041b582b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76df23454a3c4a9bb4f61b044ed5a426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:08.537472 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-5b2b1036-7889-4e94-b395-f2849b060839 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] 10.222.0.20 "GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f" status: 200 len: 1563 microversion: 2.1 time: 0.161210 Jul 30 05:03:08.538043 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 344/722] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:03:08 2022] GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f => generated 1563 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:03:09.044289 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-2672b2b0-4c37-4258-b3e0-2509ab5b7fbb tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:09.045803 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-2672b2b0-4c37-4258-b3e0-2509ab5b7fbb tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:09.054586 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2672b2b0-4c37-4258-b3e0-2509ab5b7fbb tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:09.055041 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2672b2b0-4c37-4258-b3e0-2509ab5b7fbb tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:09.055819 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2672b2b0-4c37-4258-b3e0-2509ab5b7fbb tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:09.056264 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2672b2b0-4c37-4258-b3e0-2509ab5b7fbb tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:09.285301 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-2672b2b0-4c37-4258-b3e0-2509ab5b7fbb tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:09.293591 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-2672b2b0-4c37-4258-b3e0-2509ab5b7fbb tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:09.295259 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-2672b2b0-4c37-4258-b3e0-2509ab5b7fbb tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:09.296694 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-2672b2b0-4c37-4258-b3e0-2509ab5b7fbb tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b" status: 200 len: 1340 microversion: 2.20 time: 0.256392 Jul 30 05:03:09.297355 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 379/723] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:03:09 2022] GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b => generated 1340 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 05:03:09.559362 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-e9043c03-1733-422f-87c3-487ffdf6c504 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:09.561498 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-e9043c03-1733-422f-87c3-487ffdf6c504 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] [instance: 99b497c8-e641-428a-94b6-86c21af5844f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:09.569733 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e9043c03-1733-422f-87c3-487ffdf6c504 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:09.570308 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e9043c03-1733-422f-87c3-487ffdf6c504 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:09.571675 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e9043c03-1733-422f-87c3-487ffdf6c504 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:09.572757 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e9043c03-1733-422f-87c3-487ffdf6c504 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:09.796132 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-e9043c03-1733-422f-87c3-487ffdf6c504 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a98edf8e5a4a22b3ae7d041b582b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76df23454a3c4a9bb4f61b044ed5a426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:09.807521 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-e9043c03-1733-422f-87c3-487ffdf6c504 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] 10.222.0.20 "GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f" status: 200 len: 1563 microversion: 2.1 time: 0.252308 Jul 30 05:03:09.817982 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 345/724] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:03:09 2022] GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f => generated 1563 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 05:03:10.316673 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-c29fd1c6-ce86-4ec7-9e9a-219c86cd9353 req-ba447393-e902-4673-b99d-acbeacac4721 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b", "tag": "6ca5af71-3aff-4af4-9271-ac47c637cc34"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:03:10.321455 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-ea5cf602-616c-4d00-a476-c48e98bcf866 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:10.322348 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-ea5cf602-616c-4d00-a476-c48e98bcf866 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:10.327674 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-c29fd1c6-ce86-4ec7-9e9a-219c86cd9353 req-ba447393-e902-4673-b99d-acbeacac4721 service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:10.328254 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-c29fd1c6-ce86-4ec7-9e9a-219c86cd9353 req-ba447393-e902-4673-b99d-acbeacac4721 service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:10.332026 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ea5cf602-616c-4d00-a476-c48e98bcf866 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:10.332486 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ea5cf602-616c-4d00-a476-c48e98bcf866 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:10.333309 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ea5cf602-616c-4d00-a476-c48e98bcf866 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:10.334044 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ea5cf602-616c-4d00-a476-c48e98bcf866 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:10.344030 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-c29fd1c6-ce86-4ec7-9e9a-219c86cd9353 req-ba447393-e902-4673-b99d-acbeacac4721 service nova] Creating event network-changed:6ca5af71-3aff-4af4-9271-ac47c637cc34 for instance b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b on hv-cinder-85127 Jul 30 05:03:10.349875 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-c29fd1c6-ce86-4ec7-9e9a-219c86cd9353 req-ba447393-e902-4673-b99d-acbeacac4721 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037137 Jul 30 05:03:10.350933 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 380/725] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Jul 30 05:03:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 05:03:10.579937 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-ea5cf602-616c-4d00-a476-c48e98bcf866 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:10.588682 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-ea5cf602-616c-4d00-a476-c48e98bcf866 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:10.590494 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-ea5cf602-616c-4d00-a476-c48e98bcf866 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:10.591745 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-ea5cf602-616c-4d00-a476-c48e98bcf866 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b" status: 200 len: 1408 microversion: 2.20 time: 0.275857 Jul 30 05:03:10.592431 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 346/726] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:03:10 2022] GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b => generated 1408 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 05:03:10.831433 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-6df641b5-e231-4062-8965-918ebd21a19e tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:10.831433 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-6df641b5-e231-4062-8965-918ebd21a19e tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] [instance: 99b497c8-e641-428a-94b6-86c21af5844f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:10.837251 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6df641b5-e231-4062-8965-918ebd21a19e tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:10.837694 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6df641b5-e231-4062-8965-918ebd21a19e tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:10.838757 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6df641b5-e231-4062-8965-918ebd21a19e tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:10.839358 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6df641b5-e231-4062-8965-918ebd21a19e tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:11.076532 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-6df641b5-e231-4062-8965-918ebd21a19e tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a98edf8e5a4a22b3ae7d041b582b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76df23454a3c4a9bb4f61b044ed5a426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:11.084534 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-6df641b5-e231-4062-8965-918ebd21a19e tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] 10.222.0.20 "GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f" status: 200 len: 1563 microversion: 2.1 time: 0.259025 Jul 30 05:03:11.085060 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 381/727] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:03:10 2022] GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f => generated 1563 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:03:11.614401 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-0db43fbe-f481-471e-8e10-e6de14f39043 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:11.615154 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-0db43fbe-f481-471e-8e10-e6de14f39043 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:11.621907 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0db43fbe-f481-471e-8e10-e6de14f39043 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:11.622594 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0db43fbe-f481-471e-8e10-e6de14f39043 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:11.623367 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0db43fbe-f481-471e-8e10-e6de14f39043 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:11.623808 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0db43fbe-f481-471e-8e10-e6de14f39043 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:12.066533 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-0db43fbe-f481-471e-8e10-e6de14f39043 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:12.076948 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-0db43fbe-f481-471e-8e10-e6de14f39043 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:12.078484 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-0db43fbe-f481-471e-8e10-e6de14f39043 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:12.079989 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-0db43fbe-f481-471e-8e10-e6de14f39043 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b" status: 200 len: 1408 microversion: 2.20 time: 0.469763 Jul 30 05:03:12.080957 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 347/728] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:03:11 2022] GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b => generated 1408 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 05:03:12.105258 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-41f93310-d557-427d-975d-68564d2bcbce tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:12.106129 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-41f93310-d557-427d-975d-68564d2bcbce tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] [instance: 99b497c8-e641-428a-94b6-86c21af5844f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:12.114791 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-41f93310-d557-427d-975d-68564d2bcbce tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:12.115254 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-41f93310-d557-427d-975d-68564d2bcbce tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:12.116039 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-41f93310-d557-427d-975d-68564d2bcbce tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:12.116556 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-41f93310-d557-427d-975d-68564d2bcbce tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:12.272300 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-41f93310-d557-427d-975d-68564d2bcbce tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a98edf8e5a4a22b3ae7d041b582b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76df23454a3c4a9bb4f61b044ed5a426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:12.281779 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-41f93310-d557-427d-975d-68564d2bcbce tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] 10.222.0.20 "GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f" status: 200 len: 1563 microversion: 2.1 time: 0.179610 Jul 30 05:03:12.282490 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 382/729] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:03:12 2022] GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f => generated 1563 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:03:13.103926 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-887e0ab8-5066-4094-ab79-6c60f008e04f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:13.104569 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-887e0ab8-5066-4094-ab79-6c60f008e04f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:13.111603 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-887e0ab8-5066-4094-ab79-6c60f008e04f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:13.112709 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-887e0ab8-5066-4094-ab79-6c60f008e04f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:13.113513 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-887e0ab8-5066-4094-ab79-6c60f008e04f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:13.113962 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-887e0ab8-5066-4094-ab79-6c60f008e04f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:13.304495 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-23f5a8a6-471a-4f8f-a3e7-eb48914deac1 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:13.305171 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-23f5a8a6-471a-4f8f-a3e7-eb48914deac1 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] [instance: 99b497c8-e641-428a-94b6-86c21af5844f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:13.311665 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-23f5a8a6-471a-4f8f-a3e7-eb48914deac1 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:13.312111 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-23f5a8a6-471a-4f8f-a3e7-eb48914deac1 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:13.312876 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-23f5a8a6-471a-4f8f-a3e7-eb48914deac1 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:13.313494 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-23f5a8a6-471a-4f8f-a3e7-eb48914deac1 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:13.400838 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-887e0ab8-5066-4094-ab79-6c60f008e04f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:13.417397 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-887e0ab8-5066-4094-ab79-6c60f008e04f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:13.420175 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-887e0ab8-5066-4094-ab79-6c60f008e04f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:13.421895 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-887e0ab8-5066-4094-ab79-6c60f008e04f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b" status: 200 len: 1408 microversion: 2.20 time: 0.322338 Jul 30 05:03:13.425423 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 348/730] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:03:13 2022] GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b => generated 1408 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 05:03:13.491426 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-23f5a8a6-471a-4f8f-a3e7-eb48914deac1 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a98edf8e5a4a22b3ae7d041b582b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76df23454a3c4a9bb4f61b044ed5a426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:13.500034 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-23f5a8a6-471a-4f8f-a3e7-eb48914deac1 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] 10.222.0.20 "GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f" status: 200 len: 1563 microversion: 2.1 time: 0.199277 Jul 30 05:03:13.500693 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 383/731] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:03:13 2022] GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f => generated 1563 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:03:14.444897 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-45f141b6-7d1f-41bf-a56c-dd4d46f3f73a tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:14.445704 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-45f141b6-7d1f-41bf-a56c-dd4d46f3f73a tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:14.452174 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-45f141b6-7d1f-41bf-a56c-dd4d46f3f73a tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:14.452666 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-45f141b6-7d1f-41bf-a56c-dd4d46f3f73a tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:14.453442 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-45f141b6-7d1f-41bf-a56c-dd4d46f3f73a tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:14.453889 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-45f141b6-7d1f-41bf-a56c-dd4d46f3f73a tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:14.523585 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-d1c3616c-8225-40e4-aa27-546cc7fe9fb7 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:14.524370 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-d1c3616c-8225-40e4-aa27-546cc7fe9fb7 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] [instance: 99b497c8-e641-428a-94b6-86c21af5844f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:14.536302 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d1c3616c-8225-40e4-aa27-546cc7fe9fb7 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:14.537130 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d1c3616c-8225-40e4-aa27-546cc7fe9fb7 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:14.538313 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d1c3616c-8225-40e4-aa27-546cc7fe9fb7 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:14.539935 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d1c3616c-8225-40e4-aa27-546cc7fe9fb7 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:14.680042 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-45f141b6-7d1f-41bf-a56c-dd4d46f3f73a tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:14.693740 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-45f141b6-7d1f-41bf-a56c-dd4d46f3f73a tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:14.695916 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-45f141b6-7d1f-41bf-a56c-dd4d46f3f73a tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:14.697064 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-45f141b6-7d1f-41bf-a56c-dd4d46f3f73a tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b" status: 200 len: 1408 microversion: 2.20 time: 0.256059 Jul 30 05:03:14.697637 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 349/732] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:03:14 2022] GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b => generated 1408 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 05:03:14.730697 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-d1c3616c-8225-40e4-aa27-546cc7fe9fb7 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a98edf8e5a4a22b3ae7d041b582b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76df23454a3c4a9bb4f61b044ed5a426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:14.739700 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-d1c3616c-8225-40e4-aa27-546cc7fe9fb7 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] 10.222.0.20 "GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f" status: 200 len: 1563 microversion: 2.1 time: 0.221953 Jul 30 05:03:14.742925 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 384/733] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:03:14 2022] GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f => generated 1563 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:03:15.211295 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-4ba3ea07-1a5a-4dd4-81c0-d76c3dbf89d1 req-16317346-3377-47cf-b4a8-4d9fec82624a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b", "name": "network-vif-plugged", "status": "completed", "tag": "6ca5af71-3aff-4af4-9271-ac47c637cc34"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:03:15.228076 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-4ba3ea07-1a5a-4dd4-81c0-d76c3dbf89d1 req-16317346-3377-47cf-b4a8-4d9fec82624a service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:15.228532 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-4ba3ea07-1a5a-4dd4-81c0-d76c3dbf89d1 req-16317346-3377-47cf-b4a8-4d9fec82624a service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:15.253875 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-4ba3ea07-1a5a-4dd4-81c0-d76c3dbf89d1 req-16317346-3377-47cf-b4a8-4d9fec82624a service nova] Creating event network-vif-plugged:6ca5af71-3aff-4af4-9271-ac47c637cc34 for instance b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b on hv-cinder-85127 Jul 30 05:03:15.259849 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-4ba3ea07-1a5a-4dd4-81c0-d76c3dbf89d1 req-16317346-3377-47cf-b4a8-4d9fec82624a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052251 Jul 30 05:03:15.261487 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 350/734] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Jul 30 05:03:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 05:03:15.725828 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-a6d0083e-ce9f-4bcc-ad42-02c1742f970c tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:15.727053 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-a6d0083e-ce9f-4bcc-ad42-02c1742f970c tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:15.734605 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a6d0083e-ce9f-4bcc-ad42-02c1742f970c tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:15.735175 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a6d0083e-ce9f-4bcc-ad42-02c1742f970c tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:15.736208 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a6d0083e-ce9f-4bcc-ad42-02c1742f970c tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:15.736805 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a6d0083e-ce9f-4bcc-ad42-02c1742f970c tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:15.765128 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-a402ab9f-fdec-4e81-b52a-f36cd67f140e tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:15.766458 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-a402ab9f-fdec-4e81-b52a-f36cd67f140e tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] [instance: 99b497c8-e641-428a-94b6-86c21af5844f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:15.778101 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a402ab9f-fdec-4e81-b52a-f36cd67f140e tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:15.782932 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a402ab9f-fdec-4e81-b52a-f36cd67f140e tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:15.784938 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a402ab9f-fdec-4e81-b52a-f36cd67f140e tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:15.785734 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a402ab9f-fdec-4e81-b52a-f36cd67f140e tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:15.945476 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-a6d0083e-ce9f-4bcc-ad42-02c1742f970c tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:15.966198 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-a6d0083e-ce9f-4bcc-ad42-02c1742f970c tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:15.969663 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-a6d0083e-ce9f-4bcc-ad42-02c1742f970c tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:15.971657 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-a6d0083e-ce9f-4bcc-ad42-02c1742f970c tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b" status: 200 len: 1408 microversion: 2.20 time: 0.250696 Jul 30 05:03:15.988346 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 385/735] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:03:15 2022] GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b => generated 1408 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 05:03:16.090705 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-a402ab9f-fdec-4e81-b52a-f36cd67f140e tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a98edf8e5a4a22b3ae7d041b582b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76df23454a3c4a9bb4f61b044ed5a426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:16.099851 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-a402ab9f-fdec-4e81-b52a-f36cd67f140e tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] 10.222.0.20 "GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f" status: 200 len: 1563 microversion: 2.1 time: 0.338860 Jul 30 05:03:16.114859 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 351/736] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:03:15 2022] GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f => generated 1563 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:03:16.999660 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-4a37e609-038c-4734-981f-71b9fa17c22c tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:17.000560 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-4a37e609-038c-4734-981f-71b9fa17c22c tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:17.008915 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4a37e609-038c-4734-981f-71b9fa17c22c tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:17.009600 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4a37e609-038c-4734-981f-71b9fa17c22c tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:17.010746 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4a37e609-038c-4734-981f-71b9fa17c22c tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:17.011483 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4a37e609-038c-4734-981f-71b9fa17c22c tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:17.023483 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:03:17.189133 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-972276eb-da59-4ac5-a80f-c032d00b39ad tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:17.195518 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-972276eb-da59-4ac5-a80f-c032d00b39ad tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] [instance: 99b497c8-e641-428a-94b6-86c21af5844f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:17.200910 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-4a37e609-038c-4734-981f-71b9fa17c22c tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:17.203593 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-972276eb-da59-4ac5-a80f-c032d00b39ad tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:17.204291 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-972276eb-da59-4ac5-a80f-c032d00b39ad tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:17.205290 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-972276eb-da59-4ac5-a80f-c032d00b39ad tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:17.206239 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-972276eb-da59-4ac5-a80f-c032d00b39ad tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:17.212853 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-4a37e609-038c-4734-981f-71b9fa17c22c tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:17.214463 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-4a37e609-038c-4734-981f-71b9fa17c22c tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:17.215629 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-4a37e609-038c-4734-981f-71b9fa17c22c tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b" status: 200 len: 1408 microversion: 2.20 time: 0.219852 Jul 30 05:03:17.216684 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 386/737] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:03:16 2022] GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b => generated 1408 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 05:03:17.375708 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-972276eb-da59-4ac5-a80f-c032d00b39ad tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a98edf8e5a4a22b3ae7d041b582b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76df23454a3c4a9bb4f61b044ed5a426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:17.386760 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-972276eb-da59-4ac5-a80f-c032d00b39ad tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] 10.222.0.20 "GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f" status: 200 len: 1563 microversion: 2.1 time: 0.204960 Jul 30 05:03:17.388051 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 352/738] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:03:17 2022] GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f => generated 1563 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:03:18.242314 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-472c5cab-9c96-4c69-99db-38ab94325513 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:18.243946 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-472c5cab-9c96-4c69-99db-38ab94325513 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:18.247218 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell0:SELECT=2 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:03:18.254857 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-472c5cab-9c96-4c69-99db-38ab94325513 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:18.255685 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-472c5cab-9c96-4c69-99db-38ab94325513 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:18.256763 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-472c5cab-9c96-4c69-99db-38ab94325513 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:18.257271 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-472c5cab-9c96-4c69-99db-38ab94325513 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:18.412687 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-222a4b81-1c08-49a9-9b9a-4228686b89bf tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:18.412687 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-222a4b81-1c08-49a9-9b9a-4228686b89bf tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] [instance: 99b497c8-e641-428a-94b6-86c21af5844f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:18.414857 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell0:SELECT=2 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:03:18.415594 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell0:SELECT=10 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:03:18.422716 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-222a4b81-1c08-49a9-9b9a-4228686b89bf tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:18.423248 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-222a4b81-1c08-49a9-9b9a-4228686b89bf tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:18.424484 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-222a4b81-1c08-49a9-9b9a-4228686b89bf tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:18.425186 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-222a4b81-1c08-49a9-9b9a-4228686b89bf tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:18.451001 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-472c5cab-9c96-4c69-99db-38ab94325513 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:18.463661 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-472c5cab-9c96-4c69-99db-38ab94325513 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:18.466311 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-472c5cab-9c96-4c69-99db-38ab94325513 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:18.467921 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-472c5cab-9c96-4c69-99db-38ab94325513 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b" status: 200 len: 1600 microversion: 2.20 time: 0.231604 Jul 30 05:03:18.468635 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 387/739] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:03:18 2022] GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b => generated 1600 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 05:03:18.493074 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-ec143d10-1353-4cb9-b8a0-aae32b855e5f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:18.494519 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-ec143d10-1353-4cb9-b8a0-aae32b855e5f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:18.506977 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ec143d10-1353-4cb9-b8a0-aae32b855e5f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:18.509040 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ec143d10-1353-4cb9-b8a0-aae32b855e5f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:18.509223 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ec143d10-1353-4cb9-b8a0-aae32b855e5f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:18.509869 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ec143d10-1353-4cb9-b8a0-aae32b855e5f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:18.612536 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-222a4b81-1c08-49a9-9b9a-4228686b89bf tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a98edf8e5a4a22b3ae7d041b582b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76df23454a3c4a9bb4f61b044ed5a426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:18.629316 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-222a4b81-1c08-49a9-9b9a-4228686b89bf tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] 10.222.0.20 "GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f" status: 200 len: 1563 microversion: 2.1 time: 0.223552 Jul 30 05:03:18.629997 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 353/740] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:03:18 2022] GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f => generated 1563 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 05:03:18.975685 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-ec143d10-1353-4cb9-b8a0-aae32b855e5f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.487891 Jul 30 05:03:18.983329 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 388/741] 10.222.0.20 () {60 vars in 1316 bytes} [Sat Jul 30 05:03:18 2022] GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b/os-interface => generated 284 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 05:03:19.655035 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-771fd1d5-4329-4799-a42a-1df8f5d8d8ba tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:19.655829 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-771fd1d5-4329-4799-a42a-1df8f5d8d8ba tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] [instance: 99b497c8-e641-428a-94b6-86c21af5844f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:19.664858 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-771fd1d5-4329-4799-a42a-1df8f5d8d8ba tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:19.665448 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-771fd1d5-4329-4799-a42a-1df8f5d8d8ba tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:19.666601 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-771fd1d5-4329-4799-a42a-1df8f5d8d8ba tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:19.667164 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-771fd1d5-4329-4799-a42a-1df8f5d8d8ba tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:19.843314 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-771fd1d5-4329-4799-a42a-1df8f5d8d8ba tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a98edf8e5a4a22b3ae7d041b582b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76df23454a3c4a9bb4f61b044ed5a426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:19.855553 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-771fd1d5-4329-4799-a42a-1df8f5d8d8ba tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] 10.222.0.20 "GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f" status: 200 len: 1563 microversion: 2.1 time: 0.207009 Jul 30 05:03:19.872711 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 354/742] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:03:19 2022] GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f => generated 1563 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:03:20.749902 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-d45c3c87-550a-439c-9a85-8853cda1adf5 req-ca12e98a-5c7d-423f-89de-e2ad03625b32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b", "tag": "6ca5af71-3aff-4af4-9271-ac47c637cc34"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:03:20.776766 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-d45c3c87-550a-439c-9a85-8853cda1adf5 req-ca12e98a-5c7d-423f-89de-e2ad03625b32 service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:20.777218 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-d45c3c87-550a-439c-9a85-8853cda1adf5 req-ca12e98a-5c7d-423f-89de-e2ad03625b32 service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:20.803408 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-d45c3c87-550a-439c-9a85-8853cda1adf5 req-ca12e98a-5c7d-423f-89de-e2ad03625b32 service nova] Creating event network-changed:6ca5af71-3aff-4af4-9271-ac47c637cc34 for instance b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b on hv-cinder-85127 Jul 30 05:03:20.820339 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-d45c3c87-550a-439c-9a85-8853cda1adf5 req-ca12e98a-5c7d-423f-89de-e2ad03625b32 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070819 Jul 30 05:03:20.821272 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 389/743] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Jul 30 05:03:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 05:03:20.878088 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-dc292d2a-6f22-4004-8b5e-ce6b973f0df3 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:20.879250 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-dc292d2a-6f22-4004-8b5e-ce6b973f0df3 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] [instance: 99b497c8-e641-428a-94b6-86c21af5844f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:20.898343 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-dc292d2a-6f22-4004-8b5e-ce6b973f0df3 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:20.899994 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-dc292d2a-6f22-4004-8b5e-ce6b973f0df3 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:20.905481 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-dc292d2a-6f22-4004-8b5e-ce6b973f0df3 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:20.911864 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-dc292d2a-6f22-4004-8b5e-ce6b973f0df3 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:20.966880 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-4145ca1d-bc96-485e-a71c-1c5b30e6f96e tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:20.969304 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-4145ca1d-bc96-485e-a71c-1c5b30e6f96e tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: 0a2aa4b1-2fd2-45e4-a058-71f0855e48c0] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:20.986475 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4145ca1d-bc96-485e-a71c-1c5b30e6f96e tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:20.987615 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4145ca1d-bc96-485e-a71c-1c5b30e6f96e tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:20.989021 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4145ca1d-bc96-485e-a71c-1c5b30e6f96e tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:20.995404 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4145ca1d-bc96-485e-a71c-1c5b30e6f96e tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:21.059335 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-4145ca1d-bc96-485e-a71c-1c5b30e6f96e tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/0a2aa4b1-2fd2-45e4-a058-71f0855e48c0/ips" status: 200 len: 148 microversion: 2.1 time: 0.097191 Jul 30 05:03:21.063272 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 390/744] 10.222.0.20 () {58 vars in 1248 bytes} [Sat Jul 30 05:03:20 2022] GET /compute/v2.1/servers/0a2aa4b1-2fd2-45e4-a058-71f0855e48c0/ips => generated 148 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 05:03:21.317718 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-dc292d2a-6f22-4004-8b5e-ce6b973f0df3 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a98edf8e5a4a22b3ae7d041b582b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76df23454a3c4a9bb4f61b044ed5a426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:21.323958 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:03:21.327073 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-dc292d2a-6f22-4004-8b5e-ce6b973f0df3 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] 10.222.0.20 "GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f" status: 200 len: 1563 microversion: 2.1 time: 0.453348 Jul 30 05:03:21.331291 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 355/745] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:03:20 2022] GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f => generated 1563 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:03:22.355492 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-85b41b62-7f38-419d-9b4a-1bfb3d2ab187 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:22.356716 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-85b41b62-7f38-419d-9b4a-1bfb3d2ab187 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] [instance: 99b497c8-e641-428a-94b6-86c21af5844f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:22.373418 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-85b41b62-7f38-419d-9b4a-1bfb3d2ab187 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:22.379085 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-85b41b62-7f38-419d-9b4a-1bfb3d2ab187 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:22.381138 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-85b41b62-7f38-419d-9b4a-1bfb3d2ab187 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:22.394723 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-85b41b62-7f38-419d-9b4a-1bfb3d2ab187 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:22.763188 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-85b41b62-7f38-419d-9b4a-1bfb3d2ab187 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a98edf8e5a4a22b3ae7d041b582b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76df23454a3c4a9bb4f61b044ed5a426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:22.772624 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-85b41b62-7f38-419d-9b4a-1bfb3d2ab187 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] 10.222.0.20 "GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f" status: 200 len: 1563 microversion: 2.1 time: 0.426818 Jul 30 05:03:22.776252 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 391/746] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:03:22 2022] GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f => generated 1563 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:03:23.240906 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-f18f8c3d-dd27-49bf-88b4-963f86a1fd1f tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b03df36c-0442-4a2a-9694-475ee6ee4db6"}} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:03:23.243871 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-f18f8c3d-dd27-49bf-88b4-963f86a1fd1f tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: 0a2aa4b1-2fd2-45e4-a058-71f0855e48c0] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:23.253847 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f18f8c3d-dd27-49bf-88b4-963f86a1fd1f tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:23.254532 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f18f8c3d-dd27-49bf-88b4-963f86a1fd1f tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:23.255492 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f18f8c3d-dd27-49bf-88b4-963f86a1fd1f tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:23.256098 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f18f8c3d-dd27-49bf-88b4-963f86a1fd1f tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:23.795861 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-ee7d359c-bc51-4905-a50d-fddbb22dc9cf tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:23.797082 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-ee7d359c-bc51-4905-a50d-fddbb22dc9cf tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] [instance: 99b497c8-e641-428a-94b6-86c21af5844f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:23.805552 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ee7d359c-bc51-4905-a50d-fddbb22dc9cf tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:23.806165 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ee7d359c-bc51-4905-a50d-fddbb22dc9cf tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:23.807255 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ee7d359c-bc51-4905-a50d-fddbb22dc9cf tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:23.807977 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ee7d359c-bc51-4905-a50d-fddbb22dc9cf tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:24.029671 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-ee7d359c-bc51-4905-a50d-fddbb22dc9cf tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a98edf8e5a4a22b3ae7d041b582b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76df23454a3c4a9bb4f61b044ed5a426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:24.044399 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-ee7d359c-bc51-4905-a50d-fddbb22dc9cf tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] 10.222.0.20 "GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f" status: 200 len: 1563 microversion: 2.1 time: 0.252575 Jul 30 05:03:24.054864 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 392/747] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:03:23 2022] GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f => generated 1563 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:03:24.063109 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-1b0f61b3-43fc-4161-b921-a04875871b9d tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:24.063633 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-1b0f61b3-43fc-4161-b921-a04875871b9d tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 65b7a5ff-be03-4f45-941c-26a50cdabf02] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:24.070542 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1b0f61b3-43fc-4161-b921-a04875871b9d tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:24.071003 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1b0f61b3-43fc-4161-b921-a04875871b9d tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:24.071788 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1b0f61b3-43fc-4161-b921-a04875871b9d tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:24.072220 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1b0f61b3-43fc-4161-b921-a04875871b9d tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:24.170147 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.objects.instance [None req-1b0f61b3-43fc-4161-b921-a04875871b9d tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lazy-loading 'services' on Instance uuid 65b7a5ff-be03-4f45-941c-26a50cdabf02 {{(pid=117886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 05:03:24.339069 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-1b0f61b3-43fc-4161-b921-a04875871b9d tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "DELETE /compute/v2.1/servers/65b7a5ff-be03-4f45-941c-26a50cdabf02/os-volume_attachments/d413de6f-e0d4-4e0d-958b-99855c762397" status: 202 len: 0 microversion: 2.1 time: 0.280401 Jul 30 05:03:24.341443 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 393/748] 10.222.0.20 () {58 vars in 1416 bytes} [Sat Jul 30 05:03:24 2022] DELETE /compute/v2.1/servers/65b7a5ff-be03-4f45-941c-26a50cdabf02/os-volume_attachments/d413de6f-e0d4-4e0d-958b-99855c762397 => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 05:03:24.352078 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-22423e6b-d46d-4ccf-8f29-561bf74cf445 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:24.354543 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-22423e6b-d46d-4ccf-8f29-561bf74cf445 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 65b7a5ff-be03-4f45-941c-26a50cdabf02] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:24.361243 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-22423e6b-d46d-4ccf-8f29-561bf74cf445 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:24.361815 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-22423e6b-d46d-4ccf-8f29-561bf74cf445 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:24.362719 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-22423e6b-d46d-4ccf-8f29-561bf74cf445 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:24.363227 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-22423e6b-d46d-4ccf-8f29-561bf74cf445 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:24.397273 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-22423e6b-d46d-4ccf-8f29-561bf74cf445 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/65b7a5ff-be03-4f45-941c-26a50cdabf02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051043 Jul 30 05:03:24.397861 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 394/749] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Jul 30 05:03:24 2022] GET /compute/v2.1/servers/65b7a5ff-be03-4f45-941c-26a50cdabf02/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 05:03:24.860018 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-f18f8c3d-dd27-49bf-88b4-963f86a1fd1f tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "POST /compute/v2.1/servers/0a2aa4b1-2fd2-45e4-a058-71f0855e48c0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.623936 Jul 30 05:03:24.860947 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 356/750] 10.222.0.20 () {60 vars in 1323 bytes} [Sat Jul 30 05:03:23 2022] POST /compute/v2.1/servers/0a2aa4b1-2fd2-45e4-a058-71f0855e48c0/os-volume_attachments => generated 194 bytes in 1626 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 05:03:25.065595 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-6a3e6ba8-95ff-4cd1-8f7c-682fac74bc72 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:25.066898 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-6a3e6ba8-95ff-4cd1-8f7c-682fac74bc72 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] [instance: 99b497c8-e641-428a-94b6-86c21af5844f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:25.076100 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6a3e6ba8-95ff-4cd1-8f7c-682fac74bc72 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:25.076663 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6a3e6ba8-95ff-4cd1-8f7c-682fac74bc72 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:25.077461 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6a3e6ba8-95ff-4cd1-8f7c-682fac74bc72 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:25.077906 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6a3e6ba8-95ff-4cd1-8f7c-682fac74bc72 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:25.314367 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-6a3e6ba8-95ff-4cd1-8f7c-682fac74bc72 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a98edf8e5a4a22b3ae7d041b582b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76df23454a3c4a9bb4f61b044ed5a426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:25.325643 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-6a3e6ba8-95ff-4cd1-8f7c-682fac74bc72 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] 10.222.0.20 "GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f" status: 200 len: 1563 microversion: 2.1 time: 0.264299 Jul 30 05:03:25.335247 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 395/751] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:03:25 2022] GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f => generated 1563 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:03:25.415003 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-8baeb70c-1c7f-427d-b408-109eb2773dec tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:25.422023 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-8baeb70c-1c7f-427d-b408-109eb2773dec tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 65b7a5ff-be03-4f45-941c-26a50cdabf02] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:25.431897 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8baeb70c-1c7f-427d-b408-109eb2773dec tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:25.432451 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8baeb70c-1c7f-427d-b408-109eb2773dec tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:25.433430 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8baeb70c-1c7f-427d-b408-109eb2773dec tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:25.434217 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8baeb70c-1c7f-427d-b408-109eb2773dec tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:25.478133 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-8baeb70c-1c7f-427d-b408-109eb2773dec tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/65b7a5ff-be03-4f45-941c-26a50cdabf02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072413 Jul 30 05:03:25.479285 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 357/752] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Jul 30 05:03:25 2022] GET /compute/v2.1/servers/65b7a5ff-be03-4f45-941c-26a50cdabf02/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 05:03:26.349040 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-960abb4d-aa70-4102-aadf-0bd4a187e967 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:26.350367 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-960abb4d-aa70-4102-aadf-0bd4a187e967 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] [instance: 99b497c8-e641-428a-94b6-86c21af5844f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:26.357857 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-960abb4d-aa70-4102-aadf-0bd4a187e967 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:26.358606 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-960abb4d-aa70-4102-aadf-0bd4a187e967 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:26.359562 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-960abb4d-aa70-4102-aadf-0bd4a187e967 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:26.360002 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-960abb4d-aa70-4102-aadf-0bd4a187e967 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:26.492000 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-e8ea4399-0e56-44d5-9eb8-b0f5fffe2a42 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:26.498713 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-e8ea4399-0e56-44d5-9eb8-b0f5fffe2a42 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 65b7a5ff-be03-4f45-941c-26a50cdabf02] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:26.508951 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e8ea4399-0e56-44d5-9eb8-b0f5fffe2a42 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:26.509647 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e8ea4399-0e56-44d5-9eb8-b0f5fffe2a42 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:26.513312 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e8ea4399-0e56-44d5-9eb8-b0f5fffe2a42 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:26.513991 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e8ea4399-0e56-44d5-9eb8-b0f5fffe2a42 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:26.522564 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-960abb4d-aa70-4102-aadf-0bd4a187e967 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a98edf8e5a4a22b3ae7d041b582b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76df23454a3c4a9bb4f61b044ed5a426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:26.531174 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-960abb4d-aa70-4102-aadf-0bd4a187e967 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] 10.222.0.20 "GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f" status: 200 len: 1504 microversion: 2.1 time: 0.186719 Jul 30 05:03:26.531743 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 396/753] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:03:26 2022] GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f => generated 1504 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:03:26.554987 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-e8ea4399-0e56-44d5-9eb8-b0f5fffe2a42 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/65b7a5ff-be03-4f45-941c-26a50cdabf02/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.067525 Jul 30 05:03:26.559937 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-3cfc7223-7358-46b2-8cea-9b43ed06414d tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:03:26.567095 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-3cfc7223-7358-46b2-8cea-9b43ed06414d tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] [instance: 99b497c8-e641-428a-94b6-86c21af5844f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:26.575811 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3cfc7223-7358-46b2-8cea-9b43ed06414d tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:26.576449 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3cfc7223-7358-46b2-8cea-9b43ed06414d tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:26.576654 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 358/754] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Jul 30 05:03:26 2022] GET /compute/v2.1/servers/65b7a5ff-be03-4f45-941c-26a50cdabf02/os-volume_attachments => generated 25 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 30 05:03:26.579451 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3cfc7223-7358-46b2-8cea-9b43ed06414d tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:26.581513 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3cfc7223-7358-46b2-8cea-9b43ed06414d tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:26.651045 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-860a560a-fa88-4d42-af53-0e0e88395f08 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:26.656232 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-860a560a-fa88-4d42-af53-0e0e88395f08 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 65b7a5ff-be03-4f45-941c-26a50cdabf02] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:26.666530 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-860a560a-fa88-4d42-af53-0e0e88395f08 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:26.667304 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-860a560a-fa88-4d42-af53-0e0e88395f08 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:26.668110 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-860a560a-fa88-4d42-af53-0e0e88395f08 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:26.668543 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-860a560a-fa88-4d42-af53-0e0e88395f08 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:26.703674 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-860a560a-fa88-4d42-af53-0e0e88395f08 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 65b7a5ff-be03-4f45-941c-26a50cdabf02] Going to try to terminate instance {{(pid=117885) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 05:03:26.860232 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-3cfc7223-7358-46b2-8cea-9b43ed06414d tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] [instance: 99b497c8-e641-428a-94b6-86c21af5844f] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=117886) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Jul 30 05:03:26.861324 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-860a560a-fa88-4d42-af53-0e0e88395f08 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "DELETE /compute/v2.1/servers/65b7a5ff-be03-4f45-941c-26a50cdabf02" status: 204 len: 0 microversion: 2.1 time: 0.212450 Jul 30 05:03:26.863916 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 359/755] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Jul 30 05:03:26 2022] DELETE /compute/v2.1/servers/65b7a5ff-be03-4f45-941c-26a50cdabf02 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 05:03:26.879469 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-2d4ac646-2e24-44b8-8733-f71d1093365b tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:26.880562 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-2d4ac646-2e24-44b8-8733-f71d1093365b tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 65b7a5ff-be03-4f45-941c-26a50cdabf02] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:26.897423 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2d4ac646-2e24-44b8-8733-f71d1093365b tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:26.898213 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2d4ac646-2e24-44b8-8733-f71d1093365b tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:26.899054 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2d4ac646-2e24-44b8-8733-f71d1093365b tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:26.899655 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2d4ac646-2e24-44b8-8733-f71d1093365b tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:27.001156 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-3cfc7223-7358-46b2-8cea-9b43ed06414d tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] 10.222.0.20 "POST /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f/action" status: 202 len: 0 microversion: 2.1 time: 0.447719 Jul 30 05:03:27.001762 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 397/756] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Jul 30 05:03:26 2022] POST /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f/action => generated 0 bytes in 449 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 05:03:27.010968 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-d648fbff-02b3-44c3-8c56-ad9f31101878 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:27.019150 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-d648fbff-02b3-44c3-8c56-ad9f31101878 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] [instance: 99b497c8-e641-428a-94b6-86c21af5844f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:27.031244 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d648fbff-02b3-44c3-8c56-ad9f31101878 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:27.033814 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d648fbff-02b3-44c3-8c56-ad9f31101878 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:27.037933 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d648fbff-02b3-44c3-8c56-ad9f31101878 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:27.038429 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d648fbff-02b3-44c3-8c56-ad9f31101878 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:27.110553 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-2d4ac646-2e24-44b8-8733-f71d1093365b tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:27.120621 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-2d4ac646-2e24-44b8-8733-f71d1093365b tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/65b7a5ff-be03-4f45-941c-26a50cdabf02" status: 200 len: 1687 microversion: 2.1 time: 0.251207 Jul 30 05:03:27.122478 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 360/757] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:03:26 2022] GET /compute/v2.1/servers/65b7a5ff-be03-4f45-941c-26a50cdabf02 => generated 1687 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:03:27.271236 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-d648fbff-02b3-44c3-8c56-ad9f31101878 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a98edf8e5a4a22b3ae7d041b582b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76df23454a3c4a9bb4f61b044ed5a426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:27.284605 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-d648fbff-02b3-44c3-8c56-ad9f31101878 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] 10.222.0.20 "GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f" status: 200 len: 1512 microversion: 2.1 time: 0.275799 Jul 30 05:03:27.285730 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 398/758] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:03:27 2022] GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f => generated 1512 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:03:28.164758 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-f7a516b4-7d49-420f-8901-73b9bc8b5a40 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:28.165472 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-f7a516b4-7d49-420f-8901-73b9bc8b5a40 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 65b7a5ff-be03-4f45-941c-26a50cdabf02] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:28.203662 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f7a516b4-7d49-420f-8901-73b9bc8b5a40 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:28.204116 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f7a516b4-7d49-420f-8901-73b9bc8b5a40 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:28.204917 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f7a516b4-7d49-420f-8901-73b9bc8b5a40 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:28.205454 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f7a516b4-7d49-420f-8901-73b9bc8b5a40 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:28.318207 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-bb6a5d2b-294c-4833-a79e-7d79e33d47a9 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:28.318983 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-bb6a5d2b-294c-4833-a79e-7d79e33d47a9 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] [instance: 99b497c8-e641-428a-94b6-86c21af5844f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:28.336274 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bb6a5d2b-294c-4833-a79e-7d79e33d47a9 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:28.336738 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bb6a5d2b-294c-4833-a79e-7d79e33d47a9 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:28.337522 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bb6a5d2b-294c-4833-a79e-7d79e33d47a9 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:28.337961 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bb6a5d2b-294c-4833-a79e-7d79e33d47a9 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:28.389234 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-f7a516b4-7d49-420f-8901-73b9bc8b5a40 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:28.403090 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-f7a516b4-7d49-420f-8901-73b9bc8b5a40 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/65b7a5ff-be03-4f45-941c-26a50cdabf02" status: 200 len: 1687 microversion: 2.1 time: 0.264155 Jul 30 05:03:28.416662 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 361/759] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:03:28 2022] GET /compute/v2.1/servers/65b7a5ff-be03-4f45-941c-26a50cdabf02 => generated 1687 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:03:28.507427 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-bb6a5d2b-294c-4833-a79e-7d79e33d47a9 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a98edf8e5a4a22b3ae7d041b582b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76df23454a3c4a9bb4f61b044ed5a426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:28.518688 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-bb6a5d2b-294c-4833-a79e-7d79e33d47a9 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] 10.222.0.20 "GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f" status: 200 len: 1512 microversion: 2.1 time: 0.215634 Jul 30 05:03:28.519593 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 399/760] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:03:28 2022] GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f => generated 1512 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 05:03:29.324153 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-3214d78d-1535-4822-97f6-d73208e7cffe req-1498a8fa-9822-4e51-b985-6469b43a212e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99b497c8-e641-428a-94b6-86c21af5844f", "name": "network-vif-unplugged", "status": "completed", "tag": "1a76ab0f-eada-4891-8b4c-b2af44036eb1"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:03:29.337472 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-3214d78d-1535-4822-97f6-d73208e7cffe req-1498a8fa-9822-4e51-b985-6469b43a212e service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:29.337950 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-3214d78d-1535-4822-97f6-d73208e7cffe req-1498a8fa-9822-4e51-b985-6469b43a212e service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:29.357731 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.compute.server_external_events [req-3214d78d-1535-4822-97f6-d73208e7cffe req-1498a8fa-9822-4e51-b985-6469b43a212e service nova] Unable to find a host for instance 99b497c8-e641-428a-94b6-86c21af5844f. Dropping event network-vif-unplugged {{(pid=117885) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 30 05:03:29.359243 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-3214d78d-1535-4822-97f6-d73208e7cffe req-1498a8fa-9822-4e51-b985-6469b43a212e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.039476 Jul 30 05:03:29.360362 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 362/761] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Jul 30 05:03:29 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 41 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 30 05:03:29.426154 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-b28c7bb8-f58c-41d6-87a8-ec8e08551219 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:29.426840 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-b28c7bb8-f58c-41d6-87a8-ec8e08551219 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 65b7a5ff-be03-4f45-941c-26a50cdabf02] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:29.444698 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b28c7bb8-f58c-41d6-87a8-ec8e08551219 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:29.445533 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b28c7bb8-f58c-41d6-87a8-ec8e08551219 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:29.446592 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b28c7bb8-f58c-41d6-87a8-ec8e08551219 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:29.447479 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b28c7bb8-f58c-41d6-87a8-ec8e08551219 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:29.540571 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-5e67eaaa-d3d4-4813-95c8-ab5c2ace348c tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:29.541419 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-5e67eaaa-d3d4-4813-95c8-ab5c2ace348c tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] [instance: 99b497c8-e641-428a-94b6-86c21af5844f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:29.553310 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5e67eaaa-d3d4-4813-95c8-ab5c2ace348c tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:29.555742 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5e67eaaa-d3d4-4813-95c8-ab5c2ace348c tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:29.556618 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5e67eaaa-d3d4-4813-95c8-ab5c2ace348c tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:29.557168 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5e67eaaa-d3d4-4813-95c8-ab5c2ace348c tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:29.676547 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-b28c7bb8-f58c-41d6-87a8-ec8e08551219 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:29.688077 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-b28c7bb8-f58c-41d6-87a8-ec8e08551219 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/65b7a5ff-be03-4f45-941c-26a50cdabf02" status: 200 len: 1687 microversion: 2.1 time: 0.266509 Jul 30 05:03:29.709443 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 400/762] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:03:29 2022] GET /compute/v2.1/servers/65b7a5ff-be03-4f45-941c-26a50cdabf02 => generated 1687 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:03:29.734329 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-5e67eaaa-d3d4-4813-95c8-ab5c2ace348c tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a98edf8e5a4a22b3ae7d041b582b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76df23454a3c4a9bb4f61b044ed5a426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:29.747302 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-5e67eaaa-d3d4-4813-95c8-ab5c2ace348c tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] 10.222.0.20 "GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f" status: 200 len: 1512 microversion: 2.1 time: 0.211028 Jul 30 05:03:29.747890 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 363/763] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:03:29 2022] GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f => generated 1512 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:03:30.717589 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-86ee687a-feb0-417f-abd4-ea1dca645c42 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:30.719164 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-86ee687a-feb0-417f-abd4-ea1dca645c42 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 65b7a5ff-be03-4f45-941c-26a50cdabf02] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:30.723856 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:03:30.738184 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-86ee687a-feb0-417f-abd4-ea1dca645c42 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:30.740446 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-86ee687a-feb0-417f-abd4-ea1dca645c42 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:30.743879 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-86ee687a-feb0-417f-abd4-ea1dca645c42 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:30.749169 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-86ee687a-feb0-417f-abd4-ea1dca645c42 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:30.769981 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-dd36f608-3e27-4c1a-bd48-ae2d1f88f2cb tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:30.771171 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-dd36f608-3e27-4c1a-bd48-ae2d1f88f2cb tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] [instance: 99b497c8-e641-428a-94b6-86c21af5844f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:30.786393 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:03:30.788359 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-dd36f608-3e27-4c1a-bd48-ae2d1f88f2cb tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:30.788829 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-dd36f608-3e27-4c1a-bd48-ae2d1f88f2cb tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:30.789885 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-dd36f608-3e27-4c1a-bd48-ae2d1f88f2cb tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:30.790057 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-dd36f608-3e27-4c1a-bd48-ae2d1f88f2cb tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:31.018667 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-86ee687a-feb0-417f-abd4-ea1dca645c42 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:31.029108 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-86ee687a-feb0-417f-abd4-ea1dca645c42 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/65b7a5ff-be03-4f45-941c-26a50cdabf02" status: 200 len: 1687 microversion: 2.1 time: 0.316155 Jul 30 05:03:31.030831 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 401/764] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:03:30 2022] GET /compute/v2.1/servers/65b7a5ff-be03-4f45-941c-26a50cdabf02 => generated 1687 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:03:31.170030 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-dd36f608-3e27-4c1a-bd48-ae2d1f88f2cb tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a98edf8e5a4a22b3ae7d041b582b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76df23454a3c4a9bb4f61b044ed5a426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:31.188324 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-dd36f608-3e27-4c1a-bd48-ae2d1f88f2cb tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] 10.222.0.20 "GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f" status: 200 len: 1514 microversion: 2.1 time: 0.422960 Jul 30 05:03:31.190775 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 364/765] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:03:30 2022] GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f => generated 1514 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 05:03:31.410187 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-e42fc4cb-300c-4951-9573-4d46f31d4608 req-1a5aebf1-a58f-453e-a410-5c55bafd67b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65b7a5ff-be03-4f45-941c-26a50cdabf02", "name": "network-vif-deleted", "tag": "3ee72598-16cb-4e6d-aa46-89dd6f7ad946"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:03:31.421359 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-e42fc4cb-300c-4951-9573-4d46f31d4608 req-1a5aebf1-a58f-453e-a410-5c55bafd67b9 service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:31.422136 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-e42fc4cb-300c-4951-9573-4d46f31d4608 req-1a5aebf1-a58f-453e-a410-5c55bafd67b9 service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:31.441658 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-e42fc4cb-300c-4951-9573-4d46f31d4608 req-1a5aebf1-a58f-453e-a410-5c55bafd67b9 service nova] Creating event network-vif-deleted:3ee72598-16cb-4e6d-aa46-89dd6f7ad946 for instance 65b7a5ff-be03-4f45-941c-26a50cdabf02 on hv-cinder-85127 Jul 30 05:03:31.448573 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-e42fc4cb-300c-4951-9573-4d46f31d4608 req-1a5aebf1-a58f-453e-a410-5c55bafd67b9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042804 Jul 30 05:03:31.449485 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 402/766] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Jul 30 05:03:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 05:03:32.060810 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-4c431383-3deb-4b70-8d35-7ee32e22be60 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:32.062152 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-4c431383-3deb-4b70-8d35-7ee32e22be60 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 65b7a5ff-be03-4f45-941c-26a50cdabf02] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:32.077822 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4c431383-3deb-4b70-8d35-7ee32e22be60 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:32.078810 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4c431383-3deb-4b70-8d35-7ee32e22be60 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:32.083042 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4c431383-3deb-4b70-8d35-7ee32e22be60 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:32.084317 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4c431383-3deb-4b70-8d35-7ee32e22be60 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:32.141243 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4c431383-3deb-4b70-8d35-7ee32e22be60 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:32.142167 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4c431383-3deb-4b70-8d35-7ee32e22be60 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:32.143025 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.objects.instance [None req-4c431383-3deb-4b70-8d35-7ee32e22be60 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lazy-loading 'fault' on Instance uuid 65b7a5ff-be03-4f45-941c-26a50cdabf02 {{(pid=117885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 05:03:32.213594 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-4c431383-3deb-4b70-8d35-7ee32e22be60 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:32.221836 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-0c10efa8-807c-434c-a181-ec1e57d83c42 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:32.224940 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-0c10efa8-807c-434c-a181-ec1e57d83c42 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] [instance: 99b497c8-e641-428a-94b6-86c21af5844f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:32.239826 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-4c431383-3deb-4b70-8d35-7ee32e22be60 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/65b7a5ff-be03-4f45-941c-26a50cdabf02" status: 200 len: 1334 microversion: 2.1 time: 0.171079 Jul 30 05:03:32.239826 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 365/767] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:03:32 2022] GET /compute/v2.1/servers/65b7a5ff-be03-4f45-941c-26a50cdabf02 => generated 1334 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:03:32.263107 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0c10efa8-807c-434c-a181-ec1e57d83c42 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:32.263933 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0c10efa8-807c-434c-a181-ec1e57d83c42 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:32.264969 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0c10efa8-807c-434c-a181-ec1e57d83c42 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:32.265628 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0c10efa8-807c-434c-a181-ec1e57d83c42 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:32.272737 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:03:32.538973 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-0c10efa8-807c-434c-a181-ec1e57d83c42 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a98edf8e5a4a22b3ae7d041b582b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76df23454a3c4a9bb4f61b044ed5a426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:32.551285 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-0c10efa8-807c-434c-a181-ec1e57d83c42 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] 10.222.0.20 "GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f" status: 200 len: 1514 microversion: 2.1 time: 0.343602 Jul 30 05:03:32.552612 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 403/768] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:03:32 2022] GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f => generated 1514 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:03:32.715668 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-fe4932e9-f1bc-4d03-8a3d-bcf49f0cb3a7 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b03df36c-0442-4a2a-9694-475ee6ee4db6"}} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:03:32.718268 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-fe4932e9-f1bc-4d03-8a3d-bcf49f0cb3a7 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: 0a2aa4b1-2fd2-45e4-a058-71f0855e48c0] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:32.725538 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-fe4932e9-f1bc-4d03-8a3d-bcf49f0cb3a7 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:32.725989 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-fe4932e9-f1bc-4d03-8a3d-bcf49f0cb3a7 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:32.726793 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-fe4932e9-f1bc-4d03-8a3d-bcf49f0cb3a7 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:32.727232 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-fe4932e9-f1bc-4d03-8a3d-bcf49f0cb3a7 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:32.876500 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.wsgi [None req-fe4932e9-f1bc-4d03-8a3d-bcf49f0cb3a7 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] HTTP exception thrown: Invalid volume: volume b03df36c-0442-4a2a-9694-475ee6ee4db6 is already attached to instances: 0a2aa4b1-2fd2-45e4-a058-71f0855e48c0 Jul 30 05:03:32.878864 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-fe4932e9-f1bc-4d03-8a3d-bcf49f0cb3a7 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Request method failure captured: Jul 30 05:03:32.878864 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: request: POST /compute/v2.1/servers/0a2aa4b1-2fd2-45e4-a058-71f0855e48c0/os-volume_attachments HTTP/1.1 Jul 30 05:03:32.878864 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Accept: application/json Jul 30 05:03:32.878864 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Accept-Encoding: identity Jul 30 05:03:32.878864 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Connection: close Jul 30 05:03:32.878864 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Content-Length: 74 Jul 30 05:03:32.878864 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Content-Type: application/json Jul 30 05:03:32.878864 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Host: 10.222.0.20 Jul 30 05:03:32.878864 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Openstack-System-Scope: None Jul 30 05:03:32.878864 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: User-Agent: python-urllib3/1.26.10 Jul 30 05:03:32.878864 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Auth-Token: gAAAAABi5LpsOyvntIvMWRkdgHAWaqLWWQheVZGRSyU7m8d_2qr8zQQH3DOakkgVq23Q75nTB9odGI0F-DQpTcNmJESi7-iRiz2-Pz62AvInyIstK7nwhx7nj-QdimoRc10ZS0jEzNztVniYwiMWef1RbG0o7cJ-tzIv7p3eOvqZTnGZgHQkQhc Jul 30 05:03:32.878864 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Domain-Id: None Jul 30 05:03:32.878864 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Domain-Name: None Jul 30 05:03:32.878864 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Identity-Status: Confirmed Jul 30 05:03:32.878864 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Is-Admin-Project: True Jul 30 05:03:32.878864 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Domain-Id: default Jul 30 05:03:32.878864 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Domain-Name: Default Jul 30 05:03:32.878864 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Id: e01500cb03c74d1082090cd1c1836169 Jul 30 05:03:32.878864 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Name: tempest-AttachVolumeNegativeTest-490621097 Jul 30 05:03:32.878864 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Role: member,reader Jul 30 05:03:32.878864 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Roles: member,reader Jul 30 05:03:32.880403 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e01500cb03c74d1082090cd1c1836169"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e01500cb03c74d1082090cd1c1836169"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e01500cb03c74d1082090cd1c1836169"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e01500cb03c74d1082090cd1c1836169"}]}] Jul 30 05:03:32.880403 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Tenant: tempest-AttachVolumeNegativeTest-490621097 Jul 30 05:03:32.880403 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Tenant-Id: e01500cb03c74d1082090cd1c1836169 Jul 30 05:03:32.880403 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-490621097 Jul 30 05:03:32.880403 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User: tempest-AttachVolumeNegativeTest-490621097-project Jul 30 05:03:32.880403 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Domain-Id: default Jul 30 05:03:32.880403 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Domain-Name: Default Jul 30 05:03:32.880403 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Id: a8abb58f9c274e568d2d0fe3d4df11de Jul 30 05:03:32.880403 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Name: tempest-AttachVolumeNegativeTest-490621097-project Jul 30 05:03:32.880403 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Jul 30 05:03:32.880403 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: {"volumeAttachment": {"volumeId": "b03df36c-0442-4a2a-9694-475ee6ee4db6"}} Jul 30 05:03:32.880403 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: method: > Jul 30 05:03:32.881193 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: exception: Invalid volume: volume b03df36c-0442-4a2a-9694-475ee6ee4db6 is already attached to instances: 0a2aa4b1-2fd2-45e4-a058-71f0855e48c0 Jul 30 05:03:32.881193 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: action_args: {'server_id': '0a2aa4b1-2fd2-45e4-a058-71f0855e48c0', 'body': {'volumeAttachment': {'volumeId': 'b03df36c-0442-4a2a-9694-475ee6ee4db6'}}} Jul 30 05:03:32.881193 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 05:03:32.881193 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:03:32.881193 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 30 05:03:32.881193 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 30 05:03:32.881193 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 30 05:03:32.881193 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 30 05:03:32.881193 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 30 05:03:32.881193 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 30 05:03:32.881193 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Jul 30 05:03:32.881193 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 30 05:03:32.881193 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Jul 30 05:03:32.881193 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 30 05:03:32.881193 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume b03df36c-0442-4a2a-9694-475ee6ee4db6 is already attached to instances: 0a2aa4b1-2fd2-45e4-a058-71f0855e48c0 Jul 30 05:03:32.881193 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:03:32.881193 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 05:03:32.881193 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:03:32.881193 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:03:32.882489 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 05:03:32.882489 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 05:03:32.882489 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 05:03:32.882489 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 05:03:32.882489 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 05:03:32.882489 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 05:03:32.882489 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 05:03:32.882489 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 05:03:32.882489 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 05:03:32.882489 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 05:03:32.882489 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 30 05:03:32.882489 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 30 05:03:32.882489 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 30 05:03:32.882489 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 30 05:03:32.882489 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume b03df36c-0442-4a2a-9694-475ee6ee4db6 is already attached to instances: 0a2aa4b1-2fd2-45e4-a058-71f0855e48c0 Jul 30 05:03:32.882489 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:03:32.882489 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 05:03:32.882489 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:03:32.882489 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:03:32.882489 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 05:03:32.883674 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 05:03:32.883674 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 05:03:32.883674 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 05:03:32.883674 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume b03df36c-0442-4a2a-9694-475ee6ee4db6 is already attached to instances: 0a2aa4b1-2fd2-45e4-a058-71f0855e48c0 Jul 30 05:03:32.883674 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:03:32.887166 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-fe4932e9-f1bc-4d03-8a3d-bcf49f0cb3a7 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Returning 400 to user: Invalid volume: volume b03df36c-0442-4a2a-9694-475ee6ee4db6 is already attached to instances: 0a2aa4b1-2fd2-45e4-a058-71f0855e48c0 {{(pid=117885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 05:03:32.888326 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-fe4932e9-f1bc-4d03-8a3d-bcf49f0cb3a7 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "POST /compute/v2.1/servers/0a2aa4b1-2fd2-45e4-a058-71f0855e48c0/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.176736 Jul 30 05:03:32.891452 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 366/769] 10.222.0.20 () {60 vars in 1323 bytes} [Sat Jul 30 05:03:32 2022] POST /compute/v2.1/servers/0a2aa4b1-2fd2-45e4-a058-71f0855e48c0/os-volume_attachments => generated 174 bytes in 180 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 30 05:03:32.981282 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-cc641975-0f63-4e32-901c-39502cb58871 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:32.981823 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-cc641975-0f63-4e32-901c-39502cb58871 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: 0a2aa4b1-2fd2-45e4-a058-71f0855e48c0] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:33.000317 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cc641975-0f63-4e32-901c-39502cb58871 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:33.000699 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cc641975-0f63-4e32-901c-39502cb58871 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:33.001482 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cc641975-0f63-4e32-901c-39502cb58871 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:33.003230 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-cc641975-0f63-4e32-901c-39502cb58871 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:33.135358 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.objects.instance [None req-cc641975-0f63-4e32-901c-39502cb58871 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lazy-loading 'services' on Instance uuid 0a2aa4b1-2fd2-45e4-a058-71f0855e48c0 {{(pid=117886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 05:03:33.254255 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-d7be3f0b-e43d-44a2-924c-906aa6c35740 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:33.255476 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-d7be3f0b-e43d-44a2-924c-906aa6c35740 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 65b7a5ff-be03-4f45-941c-26a50cdabf02] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:33.263244 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d7be3f0b-e43d-44a2-924c-906aa6c35740 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:33.263932 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d7be3f0b-e43d-44a2-924c-906aa6c35740 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:33.265543 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d7be3f0b-e43d-44a2-924c-906aa6c35740 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:33.266157 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d7be3f0b-e43d-44a2-924c-906aa6c35740 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:33.276069 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-cc641975-0f63-4e32-901c-39502cb58871 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0a2aa4b1-2fd2-45e4-a058-71f0855e48c0/os-volume_attachments/b03df36c-0442-4a2a-9694-475ee6ee4db6" status: 202 len: 0 microversion: 2.1 time: 0.298570 Jul 30 05:03:33.282206 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.wsgi [None req-d7be3f0b-e43d-44a2-924c-906aa6c35740 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] HTTP exception thrown: Instance 65b7a5ff-be03-4f45-941c-26a50cdabf02 could not be found. Jul 30 05:03:33.283196 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 404/770] 10.222.0.20 () {58 vars in 1416 bytes} [Sat Jul 30 05:03:32 2022] DELETE /compute/v2.1/servers/0a2aa4b1-2fd2-45e4-a058-71f0855e48c0/os-volume_attachments/b03df36c-0442-4a2a-9694-475ee6ee4db6 => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 05:03:33.285413 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-d7be3f0b-e43d-44a2-924c-906aa6c35740 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Request method failure captured: Jul 30 05:03:33.285413 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: request: GET /compute/v2.1/servers/65b7a5ff-be03-4f45-941c-26a50cdabf02 HTTP/1.1 Jul 30 05:03:33.285413 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Accept: application/json Jul 30 05:03:33.285413 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Accept-Encoding: identity Jul 30 05:03:33.285413 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Connection: close Jul 30 05:03:33.285413 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Content-Length: 0 Jul 30 05:03:33.285413 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Content-Type: application/json Jul 30 05:03:33.285413 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Host: 10.222.0.20 Jul 30 05:03:33.285413 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Openstack-System-Scope: None Jul 30 05:03:33.285413 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: User-Agent: python-urllib3/1.26.10 Jul 30 05:03:33.285413 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Auth-Token: gAAAAABi5Lpu5KZ-sBOjkiuZTtNR2YWcqU_r-_-3UQQ04xAT-w7gK_BuaWmEOr5Ju1pwtkZZzl_OTo-ZEKY-uHmyReS4PYVQ4M2aEskgI5yNySqgQDIjC3jupbHgF4azyUEFhR8JjMfCOfjvUulaZeOLaDw7yo-4-VTWVyQqf3A9DFmnALqdkU8 Jul 30 05:03:33.285413 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Domain-Id: None Jul 30 05:03:33.285413 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Domain-Name: None Jul 30 05:03:33.285413 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Identity-Status: Confirmed Jul 30 05:03:33.285413 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Is-Admin-Project: True Jul 30 05:03:33.285413 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Domain-Id: default Jul 30 05:03:33.285413 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Domain-Name: Default Jul 30 05:03:33.285413 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Id: decb0bd64582440590890900e594b79e Jul 30 05:03:33.285413 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-243408600 Jul 30 05:03:33.285413 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Role: member,reader Jul 30 05:03:33.285413 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Roles: member,reader Jul 30 05:03:33.286955 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/decb0bd64582440590890900e594b79e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/decb0bd64582440590890900e594b79e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_decb0bd64582440590890900e594b79e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/decb0bd64582440590890900e594b79e"}]}] Jul 30 05:03:33.286955 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Tenant: tempest-ServerRescueNegativeTestJSON-243408600 Jul 30 05:03:33.286955 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Tenant-Id: decb0bd64582440590890900e594b79e Jul 30 05:03:33.286955 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-243408600 Jul 30 05:03:33.286955 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User: tempest-ServerRescueNegativeTestJSON-243408600-project Jul 30 05:03:33.286955 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Domain-Id: default Jul 30 05:03:33.286955 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Domain-Name: Default Jul 30 05:03:33.286955 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Id: 25db6f7402ae4a14a04fab0a9915ab77 Jul 30 05:03:33.286955 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Name: tempest-ServerRescueNegativeTestJSON-243408600-project Jul 30 05:03:33.286955 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: method: > Jul 30 05:03:33.286955 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: exception: Instance 65b7a5ff-be03-4f45-941c-26a50cdabf02 could not be found. Jul 30 05:03:33.286955 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: action_args: {'id': '65b7a5ff-be03-4f45-941c-26a50cdabf02'} Jul 30 05:03:33.287819 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 05:03:33.287819 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:03:33.287819 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 05:03:33.287819 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 05:03:33.287819 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 05:03:33.287819 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 05:03:33.287819 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 05:03:33.287819 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 05:03:33.287819 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 05:03:33.287819 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 05:03:33.287819 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65b7a5ff-be03-4f45-941c-26a50cdabf02 could not be found. Jul 30 05:03:33.287819 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:03:33.287819 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 05:03:33.287819 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:03:33.287819 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:03:33.287819 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 05:03:33.287819 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 05:03:33.287819 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 05:03:33.287819 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 05:03:33.287819 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 05:03:33.289251 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 05:03:33.289251 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 05:03:33.289251 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 05:03:33.289251 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 05:03:33.289251 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 05:03:33.289251 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 05:03:33.289251 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 05:03:33.289251 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65b7a5ff-be03-4f45-941c-26a50cdabf02 could not be found. Jul 30 05:03:33.289251 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:03:33.289251 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 05:03:33.289251 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:03:33.289251 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:03:33.289251 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 05:03:33.289251 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 05:03:33.289251 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 05:03:33.289251 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 05:03:33.289251 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65b7a5ff-be03-4f45-941c-26a50cdabf02 could not be found. Jul 30 05:03:33.289251 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:03:33.292049 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-d7be3f0b-e43d-44a2-924c-906aa6c35740 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Returning 404 to user: Instance 65b7a5ff-be03-4f45-941c-26a50cdabf02 could not be found. {{(pid=117885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 05:03:33.293497 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-d7be3f0b-e43d-44a2-924c-906aa6c35740 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/65b7a5ff-be03-4f45-941c-26a50cdabf02" status: 404 len: 111 microversion: 2.1 time: 0.044254 Jul 30 05:03:33.293744 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-fd5535f5-634d-4a0e-9b78-dd5511ee27c0 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:33.294940 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 367/771] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:03:33 2022] GET /compute/v2.1/servers/65b7a5ff-be03-4f45-941c-26a50cdabf02 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 30 05:03:33.296944 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-fd5535f5-634d-4a0e-9b78-dd5511ee27c0 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: 0a2aa4b1-2fd2-45e4-a058-71f0855e48c0] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:33.305403 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fd5535f5-634d-4a0e-9b78-dd5511ee27c0 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:33.305907 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fd5535f5-634d-4a0e-9b78-dd5511ee27c0 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:33.307052 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fd5535f5-634d-4a0e-9b78-dd5511ee27c0 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:33.307488 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fd5535f5-634d-4a0e-9b78-dd5511ee27c0 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:33.317760 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-a8ce8e7c-2914-4bd6-a526-41b4b787a3f4 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '.version_select at 0x7f2db602e0d0>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:33.364608 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-fd5535f5-634d-4a0e-9b78-dd5511ee27c0 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/0a2aa4b1-2fd2-45e4-a058-71f0855e48c0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079920 Jul 30 05:03:33.364823 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-a8ce8e7c-2914-4bd6-a526-41b4b787a3f4 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-959895067" status: 202 len: 0 microversion: 2.1 time: 0.064488 Jul 30 05:03:33.365191 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 405/772] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Jul 30 05:03:33 2022] GET /compute/v2.1/servers/0a2aa4b1-2fd2-45e4-a058-71f0855e48c0/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 05:03:33.370570 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 368/773] 10.222.0.20 () {58 vars in 1218 bytes} [Sat Jul 30 05:03:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-959895067 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 05:03:33.572125 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-e89a749c-4010-41e1-8f7d-2dec029de6df tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:33.572754 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-e89a749c-4010-41e1-8f7d-2dec029de6df tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] [instance: 99b497c8-e641-428a-94b6-86c21af5844f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:33.582422 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e89a749c-4010-41e1-8f7d-2dec029de6df tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:33.583106 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e89a749c-4010-41e1-8f7d-2dec029de6df tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:33.584095 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e89a749c-4010-41e1-8f7d-2dec029de6df tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:33.584703 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e89a749c-4010-41e1-8f7d-2dec029de6df tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:33.834576 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-e89a749c-4010-41e1-8f7d-2dec029de6df tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a98edf8e5a4a22b3ae7d041b582b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76df23454a3c4a9bb4f61b044ed5a426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:33.843035 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-e89a749c-4010-41e1-8f7d-2dec029de6df tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] 10.222.0.20 "GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f" status: 200 len: 1570 microversion: 2.1 time: 0.274744 Jul 30 05:03:33.843663 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 406/774] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:03:33 2022] GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f => generated 1570 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:03:34.378934 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-a1dc9dd3-23b0-4b34-88b3-3887f92273df tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:34.380983 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-a1dc9dd3-23b0-4b34-88b3-3887f92273df tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: 0a2aa4b1-2fd2-45e4-a058-71f0855e48c0] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:34.394325 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a1dc9dd3-23b0-4b34-88b3-3887f92273df tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:34.394809 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a1dc9dd3-23b0-4b34-88b3-3887f92273df tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:34.395617 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a1dc9dd3-23b0-4b34-88b3-3887f92273df tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:34.396789 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a1dc9dd3-23b0-4b34-88b3-3887f92273df tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:34.432743 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-a1dc9dd3-23b0-4b34-88b3-3887f92273df tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/0a2aa4b1-2fd2-45e4-a058-71f0855e48c0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058949 Jul 30 05:03:34.434281 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 369/775] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Jul 30 05:03:34 2022] GET /compute/v2.1/servers/0a2aa4b1-2fd2-45e4-a058-71f0855e48c0/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 30 05:03:34.515804 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-84d0756b-560c-4b87-a24f-fedc043e7fab tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:34.517177 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-84d0756b-560c-4b87-a24f-fedc043e7fab tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: 0a2aa4b1-2fd2-45e4-a058-71f0855e48c0] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:34.528675 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-84d0756b-560c-4b87-a24f-fedc043e7fab tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:34.533614 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-84d0756b-560c-4b87-a24f-fedc043e7fab tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:34.535111 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-84d0756b-560c-4b87-a24f-fedc043e7fab tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:34.535776 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-84d0756b-560c-4b87-a24f-fedc043e7fab tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:34.576899 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-84d0756b-560c-4b87-a24f-fedc043e7fab tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: 0a2aa4b1-2fd2-45e4-a058-71f0855e48c0] Going to try to terminate instance {{(pid=117886) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 05:03:34.692779 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-84d0756b-560c-4b87-a24f-fedc043e7fab tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0a2aa4b1-2fd2-45e4-a058-71f0855e48c0" status: 204 len: 0 microversion: 2.1 time: 0.184040 Jul 30 05:03:34.696939 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 407/776] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Jul 30 05:03:34 2022] DELETE /compute/v2.1/servers/0a2aa4b1-2fd2-45e4-a058-71f0855e48c0 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 05:03:34.702214 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-f1ee2b06-02ba-4aa8-824f-e13161fa9170 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:34.703171 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-f1ee2b06-02ba-4aa8-824f-e13161fa9170 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: 0a2aa4b1-2fd2-45e4-a058-71f0855e48c0] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:34.710000 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f1ee2b06-02ba-4aa8-824f-e13161fa9170 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:34.710786 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f1ee2b06-02ba-4aa8-824f-e13161fa9170 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:34.712947 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f1ee2b06-02ba-4aa8-824f-e13161fa9170 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:34.713662 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f1ee2b06-02ba-4aa8-824f-e13161fa9170 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:34.868701 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-1f151e3f-5890-4ce2-a91a-38e5b06cd499 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:34.869927 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-1f151e3f-5890-4ce2-a91a-38e5b06cd499 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] [instance: 99b497c8-e641-428a-94b6-86c21af5844f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:34.873593 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-f1ee2b06-02ba-4aa8-824f-e13161fa9170 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8abb58f9c274e568d2d0fe3d4df11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01500cb03c74d1082090cd1c1836169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:34.878092 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1f151e3f-5890-4ce2-a91a-38e5b06cd499 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:34.878853 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1f151e3f-5890-4ce2-a91a-38e5b06cd499 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:34.879946 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1f151e3f-5890-4ce2-a91a-38e5b06cd499 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:34.880415 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1f151e3f-5890-4ce2-a91a-38e5b06cd499 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:34.883380 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-f1ee2b06-02ba-4aa8-824f-e13161fa9170 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/0a2aa4b1-2fd2-45e4-a058-71f0855e48c0" status: 200 len: 1679 microversion: 2.1 time: 0.185062 Jul 30 05:03:34.884301 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 370/777] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:03:34 2022] GET /compute/v2.1/servers/0a2aa4b1-2fd2-45e4-a058-71f0855e48c0 => generated 1679 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:03:35.086415 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-1f151e3f-5890-4ce2-a91a-38e5b06cd499 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a98edf8e5a4a22b3ae7d041b582b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76df23454a3c4a9bb4f61b044ed5a426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:35.094264 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-1f151e3f-5890-4ce2-a91a-38e5b06cd499 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] 10.222.0.20 "GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f" status: 200 len: 1570 microversion: 2.1 time: 0.230891 Jul 30 05:03:35.094973 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 408/778] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:03:34 2022] GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f => generated 1570 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 05:03:35.906710 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-6714b8a3-1fd2-43d4-b614-25967bd90f62 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:35.909383 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-6714b8a3-1fd2-43d4-b614-25967bd90f62 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: 0a2aa4b1-2fd2-45e4-a058-71f0855e48c0] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:35.916378 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6714b8a3-1fd2-43d4-b614-25967bd90f62 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:35.916741 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6714b8a3-1fd2-43d4-b614-25967bd90f62 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:35.917697 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6714b8a3-1fd2-43d4-b614-25967bd90f62 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:35.918305 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6714b8a3-1fd2-43d4-b614-25967bd90f62 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:35.944070 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:03:35.950735 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-71caa938-aae7-481d-a660-749dd8745c8e tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Action: 'create', calling method: .version_select at 0x7f2daf7e7a60>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-561025293", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG49RKiv5/VeutuZy90JgIYqPNcg+/NRZC7LwEPk2EjG+1rrIC9fnMpPjqLGpFNoZzGTDVq7U2NZ9y/xyzATz9snf6wg5aHbXp3lzc/tjVz8mmN9lyuUABy0aB3ZSpcboQ=="}} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:03:35.968546 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.quota [None req-71caa938-aae7-481d-a660-749dd8745c8e tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Getting quotas for project abbb209e2c194596bb3e8b9a6880646e. Resources: {'key_pairs'} {{(pid=117886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 05:03:35.973620 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.quota [None req-71caa938-aae7-481d-a660-749dd8745c8e tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Getting quotas for user 42d3708ddfcc491cb366054dcd5f8881 and project abbb209e2c194596bb3e8b9a6880646e. Resources: {'key_pairs'} {{(pid=117886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 05:03:35.995469 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-71caa938-aae7-481d-a660-749dd8745c8e tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.056056 Jul 30 05:03:35.996484 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 409/779] 10.222.0.20 () {60 vars in 1159 bytes} [Sat Jul 30 05:03:35 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 05:03:36.052226 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-75d0e1aa-b68a-4963-9177-343261feb520 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-901557145", "imageRef": "a57b6e7f-03b9-492d-a33b-19ce82fbcfdd", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-561025293", "networks": [{"uuid": "1c90acd2-47b7-4570-be05-943c9579a240"}]}} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:03:36.114533 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.network.neutron [None req-75d0e1aa-b68a-4963-9177-343261feb520 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] validate_networks() for [('1c90acd2-47b7-4570-be05-943c9579a240', None, None, None, None, None)] {{(pid=117886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 05:03:36.431540 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-6714b8a3-1fd2-43d4-b614-25967bd90f62 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8abb58f9c274e568d2d0fe3d4df11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01500cb03c74d1082090cd1c1836169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:36.440324 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-6714b8a3-1fd2-43d4-b614-25967bd90f62 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/0a2aa4b1-2fd2-45e4-a058-71f0855e48c0" status: 200 len: 1679 microversion: 2.1 time: 0.538250 Jul 30 05:03:36.441173 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 371/780] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:03:35 2022] GET /compute/v2.1/servers/0a2aa4b1-2fd2-45e4-a058-71f0855e48c0 => generated 1679 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:03:36.446533 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-34cfdc41-099f-4403-ab73-de4880e729df tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:36.447376 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-34cfdc41-099f-4403-ab73-de4880e729df tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] [instance: 99b497c8-e641-428a-94b6-86c21af5844f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:36.460634 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-34cfdc41-099f-4403-ab73-de4880e729df tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:36.461199 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-34cfdc41-099f-4403-ab73-de4880e729df tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:36.462181 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-34cfdc41-099f-4403-ab73-de4880e729df tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:36.462647 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-34cfdc41-099f-4403-ab73-de4880e729df tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:36.525024 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-75d0e1aa-b68a-4963-9177-343261feb520 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Flavor limits 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 05:03:36.525446 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-75d0e1aa-b68a-4963-9177-343261feb520 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Image limits 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 05:03:36.525914 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-75d0e1aa-b68a-4963-9177-343261feb520 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Flavor pref 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 05:03:36.526318 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-75d0e1aa-b68a-4963-9177-343261feb520 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Image pref 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 05:03:36.526819 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-75d0e1aa-b68a-4963-9177-343261feb520 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 05:03:36.541024 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-75d0e1aa-b68a-4963-9177-343261feb520 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:36.541472 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-75d0e1aa-b68a-4963-9177-343261feb520 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:36.542258 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-75d0e1aa-b68a-4963-9177-343261feb520 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:36.542749 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-75d0e1aa-b68a-4963-9177-343261feb520 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:36.560677 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.quota [None req-75d0e1aa-b68a-4963-9177-343261feb520 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Getting quotas for project abbb209e2c194596bb3e8b9a6880646e. Resources: {'ram', 'cores', 'instances'} {{(pid=117886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 05:03:36.565291 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.quota [None req-75d0e1aa-b68a-4963-9177-343261feb520 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Getting quotas for user 42d3708ddfcc491cb366054dcd5f8881 and project abbb209e2c194596bb3e8b9a6880646e. Resources: {'ram', 'cores', 'instances'} {{(pid=117886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 05:03:36.576592 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-75d0e1aa-b68a-4963-9177-343261feb520 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Going to run 1 instances... {{(pid=117886) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 05:03:36.578948 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-75d0e1aa-b68a-4963-9177-343261feb520 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] [instance: 0faad1c9-0b0d-44af-92cb-dd0acd61c755] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a57b6e7f-03b9-492d-a33b-19ce82fbcfdd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 05:03:36.625058 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-75d0e1aa-b68a-4963-9177-343261feb520 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.577917 Jul 30 05:03:36.625779 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 410/781] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Jul 30 05:03:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 579 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 30 05:03:36.636611 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-37705224-e0c5-4e2a-83a7-869b630cc6bf tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:36.637226 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-37705224-e0c5-4e2a-83a7-869b630cc6bf tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] [instance: 0faad1c9-0b0d-44af-92cb-dd0acd61c755] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:36.702103 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-37705224-e0c5-4e2a-83a7-869b630cc6bf tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42d3708ddfcc491cb366054dcd5f8881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abbb209e2c194596bb3e8b9a6880646e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:36.702856 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-34cfdc41-099f-4403-ab73-de4880e729df tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a98edf8e5a4a22b3ae7d041b582b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76df23454a3c4a9bb4f61b044ed5a426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:36.712735 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-34cfdc41-099f-4403-ab73-de4880e729df tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] 10.222.0.20 "GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f" status: 200 len: 1570 microversion: 2.1 time: 0.270134 Jul 30 05:03:36.713043 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-37705224-e0c5-4e2a-83a7-869b630cc6bf tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] 10.222.0.20 "GET /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755" status: 200 len: 1257 microversion: 2.1 time: 0.079986 Jul 30 05:03:36.713328 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 372/782] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:03:36 2022] GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f => generated 1570 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:03:36.727010 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 411/783] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:03:36 2022] GET /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755 => generated 1257 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 05:03:36.979885 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-614f10cd-5d4d-4816-87c5-c7beed1659e8 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:36.980387 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-614f10cd-5d4d-4816-87c5-c7beed1659e8 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 7b5e218d-8660-4d90-90d1-9c8e50a66a7c] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:36.988046 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-614f10cd-5d4d-4816-87c5-c7beed1659e8 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:36.988733 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-614f10cd-5d4d-4816-87c5-c7beed1659e8 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:36.989701 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-614f10cd-5d4d-4816-87c5-c7beed1659e8 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:36.990319 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-614f10cd-5d4d-4816-87c5-c7beed1659e8 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:37.025341 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-614f10cd-5d4d-4816-87c5-c7beed1659e8 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 7b5e218d-8660-4d90-90d1-9c8e50a66a7c] Going to try to terminate instance {{(pid=117885) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 05:03:37.114594 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-614f10cd-5d4d-4816-87c5-c7beed1659e8 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c" status: 204 len: 0 microversion: 2.1 time: 0.137659 Jul 30 05:03:37.116093 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 373/784] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Jul 30 05:03:36 2022] DELETE /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 05:03:37.124719 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-9223eddf-c555-4b7e-a5ee-22b45d6cb39c tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:37.125677 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-9223eddf-c555-4b7e-a5ee-22b45d6cb39c tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 7b5e218d-8660-4d90-90d1-9c8e50a66a7c] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:37.133434 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9223eddf-c555-4b7e-a5ee-22b45d6cb39c tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:37.133879 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9223eddf-c555-4b7e-a5ee-22b45d6cb39c tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:37.134904 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9223eddf-c555-4b7e-a5ee-22b45d6cb39c tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:37.135667 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9223eddf-c555-4b7e-a5ee-22b45d6cb39c tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:37.271753 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-9223eddf-c555-4b7e-a5ee-22b45d6cb39c tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:37.279382 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-9223eddf-c555-4b7e-a5ee-22b45d6cb39c tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c" status: 200 len: 1508 microversion: 2.1 time: 0.159117 Jul 30 05:03:37.279954 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 412/785] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:03:37 2022] GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c => generated 1508 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 05:03:37.321052 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-0498c82c-e849-4552-8e3f-dde0d716c014 req-7a170a84-cea8-469e-af89-cfb3070abfba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a2aa4b1-2fd2-45e4-a058-71f0855e48c0", "name": "network-vif-deleted", "tag": "be23179b-b7b9-4f47-bb71-6ace62d54931"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:03:37.331026 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-0498c82c-e849-4552-8e3f-dde0d716c014 req-7a170a84-cea8-469e-af89-cfb3070abfba service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:37.331467 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-0498c82c-e849-4552-8e3f-dde0d716c014 req-7a170a84-cea8-469e-af89-cfb3070abfba service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:37.342203 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-0498c82c-e849-4552-8e3f-dde0d716c014 req-7a170a84-cea8-469e-af89-cfb3070abfba service nova] Creating event network-vif-deleted:be23179b-b7b9-4f47-bb71-6ace62d54931 for instance 0a2aa4b1-2fd2-45e4-a058-71f0855e48c0 on hv-cinder-85127 Jul 30 05:03:37.347631 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-0498c82c-e849-4552-8e3f-dde0d716c014 req-7a170a84-cea8-469e-af89-cfb3070abfba service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030643 Jul 30 05:03:37.348221 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 374/786] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Jul 30 05:03:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 05:03:37.462358 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-8d0a81a9-3a59-4649-8901-7feff692ec48 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:37.463420 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-8d0a81a9-3a59-4649-8901-7feff692ec48 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: 0a2aa4b1-2fd2-45e4-a058-71f0855e48c0] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:37.476338 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8d0a81a9-3a59-4649-8901-7feff692ec48 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:37.476892 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8d0a81a9-3a59-4649-8901-7feff692ec48 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:37.477792 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8d0a81a9-3a59-4649-8901-7feff692ec48 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:37.478329 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8d0a81a9-3a59-4649-8901-7feff692ec48 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:37.547722 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-8d0a81a9-3a59-4649-8901-7feff692ec48 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8abb58f9c274e568d2d0fe3d4df11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01500cb03c74d1082090cd1c1836169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:37.556091 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-8d0a81a9-3a59-4649-8901-7feff692ec48 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/0a2aa4b1-2fd2-45e4-a058-71f0855e48c0" status: 200 len: 1611 microversion: 2.1 time: 0.097629 Jul 30 05:03:37.556769 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 413/787] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:03:37 2022] GET /compute/v2.1/servers/0a2aa4b1-2fd2-45e4-a058-71f0855e48c0 => generated 1611 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:03:37.733738 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-481584d1-d19f-476d-a72c-cd10fcb2c871 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:37.734447 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-481584d1-d19f-476d-a72c-cd10fcb2c871 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] [instance: 99b497c8-e641-428a-94b6-86c21af5844f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:37.740720 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-481584d1-d19f-476d-a72c-cd10fcb2c871 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:37.741166 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-481584d1-d19f-476d-a72c-cd10fcb2c871 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:37.741927 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-481584d1-d19f-476d-a72c-cd10fcb2c871 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:37.742359 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-481584d1-d19f-476d-a72c-cd10fcb2c871 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:37.747929 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-7759baf3-6a73-4abe-bd44-9de3352f60aa tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:37.748774 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-7759baf3-6a73-4abe-bd44-9de3352f60aa tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] [instance: 0faad1c9-0b0d-44af-92cb-dd0acd61c755] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:37.755474 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7759baf3-6a73-4abe-bd44-9de3352f60aa tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:37.755923 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7759baf3-6a73-4abe-bd44-9de3352f60aa tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:37.756693 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7759baf3-6a73-4abe-bd44-9de3352f60aa tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:37.757125 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7759baf3-6a73-4abe-bd44-9de3352f60aa tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:37.819005 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-7759baf3-6a73-4abe-bd44-9de3352f60aa tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42d3708ddfcc491cb366054dcd5f8881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abbb209e2c194596bb3e8b9a6880646e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:37.826639 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-7759baf3-6a73-4abe-bd44-9de3352f60aa tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] 10.222.0.20 "GET /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755" status: 200 len: 1253 microversion: 2.1 time: 0.082378 Jul 30 05:03:37.827102 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 414/788] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:03:37 2022] GET /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755 => generated 1253 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 05:03:37.883676 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-481584d1-d19f-476d-a72c-cd10fcb2c871 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a98edf8e5a4a22b3ae7d041b582b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76df23454a3c4a9bb4f61b044ed5a426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:37.891171 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-481584d1-d19f-476d-a72c-cd10fcb2c871 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] 10.222.0.20 "GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f" status: 200 len: 1570 microversion: 2.1 time: 0.161618 Jul 30 05:03:37.891738 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 375/789] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:03:37 2022] GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f => generated 1570 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 05:03:38.302489 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-15e785cc-0a62-4b80-b46a-28d18a8abc9e tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:38.303757 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-15e785cc-0a62-4b80-b46a-28d18a8abc9e tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 7b5e218d-8660-4d90-90d1-9c8e50a66a7c] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:38.310572 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-15e785cc-0a62-4b80-b46a-28d18a8abc9e tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:38.311652 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-15e785cc-0a62-4b80-b46a-28d18a8abc9e tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:38.312606 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-15e785cc-0a62-4b80-b46a-28d18a8abc9e tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:38.313207 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-15e785cc-0a62-4b80-b46a-28d18a8abc9e tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:38.455950 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-15e785cc-0a62-4b80-b46a-28d18a8abc9e tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:38.463304 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-15e785cc-0a62-4b80-b46a-28d18a8abc9e tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c" status: 200 len: 1508 microversion: 2.1 time: 0.165869 Jul 30 05:03:38.463866 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 415/790] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:03:38 2022] GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c => generated 1508 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:03:38.577166 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-5cc020ee-0241-4ae2-a41c-9d25d8fab787 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:38.577747 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-5cc020ee-0241-4ae2-a41c-9d25d8fab787 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: 0a2aa4b1-2fd2-45e4-a058-71f0855e48c0] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:38.584274 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5cc020ee-0241-4ae2-a41c-9d25d8fab787 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:38.584717 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5cc020ee-0241-4ae2-a41c-9d25d8fab787 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:38.585471 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5cc020ee-0241-4ae2-a41c-9d25d8fab787 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:38.585903 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5cc020ee-0241-4ae2-a41c-9d25d8fab787 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:38.649741 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-5cc020ee-0241-4ae2-a41c-9d25d8fab787 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8abb58f9c274e568d2d0fe3d4df11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01500cb03c74d1082090cd1c1836169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:38.657167 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-5cc020ee-0241-4ae2-a41c-9d25d8fab787 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/0a2aa4b1-2fd2-45e4-a058-71f0855e48c0" status: 200 len: 1611 microversion: 2.1 time: 0.083946 Jul 30 05:03:38.658392 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 376/791] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:03:38 2022] GET /compute/v2.1/servers/0a2aa4b1-2fd2-45e4-a058-71f0855e48c0 => generated 1611 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:03:38.848877 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-3ed4f88f-d95a-44db-be4e-94aed94bd047 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:38.849421 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-3ed4f88f-d95a-44db-be4e-94aed94bd047 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] [instance: 0faad1c9-0b0d-44af-92cb-dd0acd61c755] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:38.855482 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3ed4f88f-d95a-44db-be4e-94aed94bd047 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:38.855924 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3ed4f88f-d95a-44db-be4e-94aed94bd047 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:38.856682 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3ed4f88f-d95a-44db-be4e-94aed94bd047 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:38.857115 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3ed4f88f-d95a-44db-be4e-94aed94bd047 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:38.913745 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-7359d361-cec2-4c69-b252-766716cbf6cf tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:38.914355 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-7359d361-cec2-4c69-b252-766716cbf6cf tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] [instance: 99b497c8-e641-428a-94b6-86c21af5844f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:38.920596 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7359d361-cec2-4c69-b252-766716cbf6cf tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:38.920756 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-3ed4f88f-d95a-44db-be4e-94aed94bd047 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42d3708ddfcc491cb366054dcd5f8881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abbb209e2c194596bb3e8b9a6880646e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:38.921049 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7359d361-cec2-4c69-b252-766716cbf6cf tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:38.921808 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7359d361-cec2-4c69-b252-766716cbf6cf tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:38.922258 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7359d361-cec2-4c69-b252-766716cbf6cf tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:38.928458 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-3ed4f88f-d95a-44db-be4e-94aed94bd047 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] 10.222.0.20 "GET /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755" status: 200 len: 1253 microversion: 2.1 time: 0.084152 Jul 30 05:03:38.929029 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 416/792] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:03:38 2022] GET /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755 => generated 1253 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:03:39.062846 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-7359d361-cec2-4c69-b252-766716cbf6cf tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a98edf8e5a4a22b3ae7d041b582b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76df23454a3c4a9bb4f61b044ed5a426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:39.073898 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-7359d361-cec2-4c69-b252-766716cbf6cf tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] 10.222.0.20 "GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f" status: 200 len: 1570 microversion: 2.1 time: 0.163900 Jul 30 05:03:39.074500 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 377/793] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:03:38 2022] GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f => generated 1570 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:03:39.485142 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-2eb0f9e1-c7cd-4a0b-91dc-faef239af0da tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:39.486459 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-2eb0f9e1-c7cd-4a0b-91dc-faef239af0da tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 7b5e218d-8660-4d90-90d1-9c8e50a66a7c] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:39.492924 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2eb0f9e1-c7cd-4a0b-91dc-faef239af0da tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:39.493375 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2eb0f9e1-c7cd-4a0b-91dc-faef239af0da tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:39.494141 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2eb0f9e1-c7cd-4a0b-91dc-faef239af0da tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:39.494626 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2eb0f9e1-c7cd-4a0b-91dc-faef239af0da tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:39.629906 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-2eb0f9e1-c7cd-4a0b-91dc-faef239af0da tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:39.637429 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-2eb0f9e1-c7cd-4a0b-91dc-faef239af0da tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c" status: 200 len: 1508 microversion: 2.1 time: 0.156189 Jul 30 05:03:39.637996 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 417/794] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:03:39 2022] GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c => generated 1508 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:03:39.679849 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-d0f37981-17cb-4dd2-adfd-84e1455cf9e1 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:39.680504 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-d0f37981-17cb-4dd2-adfd-84e1455cf9e1 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: 0a2aa4b1-2fd2-45e4-a058-71f0855e48c0] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:39.687092 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d0f37981-17cb-4dd2-adfd-84e1455cf9e1 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:39.687537 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d0f37981-17cb-4dd2-adfd-84e1455cf9e1 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:39.688295 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d0f37981-17cb-4dd2-adfd-84e1455cf9e1 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:39.688729 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d0f37981-17cb-4dd2-adfd-84e1455cf9e1 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:39.721395 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d0f37981-17cb-4dd2-adfd-84e1455cf9e1 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:39.721835 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d0f37981-17cb-4dd2-adfd-84e1455cf9e1 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:39.722282 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.objects.instance [None req-d0f37981-17cb-4dd2-adfd-84e1455cf9e1 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lazy-loading 'fault' on Instance uuid 0a2aa4b1-2fd2-45e4-a058-71f0855e48c0 {{(pid=117885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 05:03:39.764202 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-d0f37981-17cb-4dd2-adfd-84e1455cf9e1 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8abb58f9c274e568d2d0fe3d4df11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01500cb03c74d1082090cd1c1836169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:39.772207 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-d0f37981-17cb-4dd2-adfd-84e1455cf9e1 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/0a2aa4b1-2fd2-45e4-a058-71f0855e48c0" status: 200 len: 1330 microversion: 2.1 time: 0.096216 Jul 30 05:03:39.772764 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 378/795] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:03:39 2022] GET /compute/v2.1/servers/0a2aa4b1-2fd2-45e4-a058-71f0855e48c0 => generated 1330 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:03:39.950698 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-5a1c25cd-6f23-4713-8532-c9720d65319f tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:39.951720 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-5a1c25cd-6f23-4713-8532-c9720d65319f tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] [instance: 0faad1c9-0b0d-44af-92cb-dd0acd61c755] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:39.959750 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5a1c25cd-6f23-4713-8532-c9720d65319f tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:39.960545 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5a1c25cd-6f23-4713-8532-c9720d65319f tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:39.961545 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5a1c25cd-6f23-4713-8532-c9720d65319f tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:39.961987 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5a1c25cd-6f23-4713-8532-c9720d65319f tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:40.039693 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-5a1c25cd-6f23-4713-8532-c9720d65319f tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42d3708ddfcc491cb366054dcd5f8881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abbb209e2c194596bb3e8b9a6880646e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:40.048519 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-5a1c25cd-6f23-4713-8532-c9720d65319f tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] 10.222.0.20 "GET /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755" status: 200 len: 1327 microversion: 2.1 time: 0.102473 Jul 30 05:03:40.049484 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 418/796] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:03:39 2022] GET /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755 => generated 1327 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:03:40.096067 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-57ccdb03-c1c1-4cb2-b920-949285f9334d tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:40.096676 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-57ccdb03-c1c1-4cb2-b920-949285f9334d tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] [instance: 99b497c8-e641-428a-94b6-86c21af5844f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:40.102782 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-57ccdb03-c1c1-4cb2-b920-949285f9334d tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:40.103228 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-57ccdb03-c1c1-4cb2-b920-949285f9334d tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:40.103983 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-57ccdb03-c1c1-4cb2-b920-949285f9334d tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:40.104411 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-57ccdb03-c1c1-4cb2-b920-949285f9334d tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:40.377266 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-57ccdb03-c1c1-4cb2-b920-949285f9334d tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a98edf8e5a4a22b3ae7d041b582b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76df23454a3c4a9bb4f61b044ed5a426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:40.389219 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-57ccdb03-c1c1-4cb2-b920-949285f9334d tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] 10.222.0.20 "GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f" status: 200 len: 1570 microversion: 2.1 time: 0.295735 Jul 30 05:03:40.391303 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 379/797] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:03:40 2022] GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f => generated 1570 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:03:40.658427 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-a7a862a5-47d1-41b0-be56-88661b049865 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:40.659669 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-a7a862a5-47d1-41b0-be56-88661b049865 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 7b5e218d-8660-4d90-90d1-9c8e50a66a7c] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:40.667526 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a7a862a5-47d1-41b0-be56-88661b049865 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:40.668292 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a7a862a5-47d1-41b0-be56-88661b049865 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:40.669249 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a7a862a5-47d1-41b0-be56-88661b049865 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:40.669693 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a7a862a5-47d1-41b0-be56-88661b049865 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:40.764441 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-a7a862a5-47d1-41b0-be56-88661b049865 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:40.773820 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-a7a862a5-47d1-41b0-be56-88661b049865 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c" status: 200 len: 1466 microversion: 2.1 time: 0.119800 Jul 30 05:03:40.784159 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 419/798] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:03:40 2022] GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c => generated 1466 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:03:40.793098 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-2c9aef97-f520-4ac8-8ccc-e626829b1051 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:40.793722 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-2c9aef97-f520-4ac8-8ccc-e626829b1051 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: 0a2aa4b1-2fd2-45e4-a058-71f0855e48c0] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:40.815088 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2c9aef97-f520-4ac8-8ccc-e626829b1051 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:40.815558 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2c9aef97-f520-4ac8-8ccc-e626829b1051 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:40.816358 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2c9aef97-f520-4ac8-8ccc-e626829b1051 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:40.816805 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2c9aef97-f520-4ac8-8ccc-e626829b1051 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:40.851052 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.wsgi [None req-2c9aef97-f520-4ac8-8ccc-e626829b1051 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] HTTP exception thrown: Instance 0a2aa4b1-2fd2-45e4-a058-71f0855e48c0 could not be found. Jul 30 05:03:40.853040 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-2c9aef97-f520-4ac8-8ccc-e626829b1051 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Request method failure captured: Jul 30 05:03:40.853040 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: request: GET /compute/v2.1/servers/0a2aa4b1-2fd2-45e4-a058-71f0855e48c0 HTTP/1.1 Jul 30 05:03:40.853040 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Accept: application/json Jul 30 05:03:40.853040 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Accept-Encoding: identity Jul 30 05:03:40.853040 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Connection: close Jul 30 05:03:40.853040 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Content-Length: 0 Jul 30 05:03:40.853040 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Content-Type: application/json Jul 30 05:03:40.853040 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Host: 10.222.0.20 Jul 30 05:03:40.853040 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Openstack-System-Scope: None Jul 30 05:03:40.853040 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: User-Agent: python-urllib3/1.26.10 Jul 30 05:03:40.853040 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Auth-Token: gAAAAABi5LpsOyvntIvMWRkdgHAWaqLWWQheVZGRSyU7m8d_2qr8zQQH3DOakkgVq23Q75nTB9odGI0F-DQpTcNmJESi7-iRiz2-Pz62AvInyIstK7nwhx7nj-QdimoRc10ZS0jEzNztVniYwiMWef1RbG0o7cJ-tzIv7p3eOvqZTnGZgHQkQhc Jul 30 05:03:40.853040 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Domain-Id: None Jul 30 05:03:40.853040 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Domain-Name: None Jul 30 05:03:40.853040 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Identity-Status: Confirmed Jul 30 05:03:40.853040 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Is-Admin-Project: True Jul 30 05:03:40.853040 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Domain-Id: default Jul 30 05:03:40.853040 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Domain-Name: Default Jul 30 05:03:40.853040 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Id: e01500cb03c74d1082090cd1c1836169 Jul 30 05:03:40.853040 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Name: tempest-AttachVolumeNegativeTest-490621097 Jul 30 05:03:40.853040 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Role: member,reader Jul 30 05:03:40.853040 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Roles: member,reader Jul 30 05:03:40.854779 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e01500cb03c74d1082090cd1c1836169"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e01500cb03c74d1082090cd1c1836169"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e01500cb03c74d1082090cd1c1836169"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e01500cb03c74d1082090cd1c1836169"}]}] Jul 30 05:03:40.854779 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Tenant: tempest-AttachVolumeNegativeTest-490621097 Jul 30 05:03:40.854779 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Tenant-Id: e01500cb03c74d1082090cd1c1836169 Jul 30 05:03:40.854779 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-490621097 Jul 30 05:03:40.854779 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User: tempest-AttachVolumeNegativeTest-490621097-project Jul 30 05:03:40.854779 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Domain-Id: default Jul 30 05:03:40.854779 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Domain-Name: Default Jul 30 05:03:40.854779 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Id: a8abb58f9c274e568d2d0fe3d4df11de Jul 30 05:03:40.854779 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Name: tempest-AttachVolumeNegativeTest-490621097-project Jul 30 05:03:40.854779 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: method: > Jul 30 05:03:40.854779 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: exception: Instance 0a2aa4b1-2fd2-45e4-a058-71f0855e48c0 could not be found. Jul 30 05:03:40.854779 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: action_args: {'id': '0a2aa4b1-2fd2-45e4-a058-71f0855e48c0'} Jul 30 05:03:40.855785 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 05:03:40.855785 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:03:40.855785 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 05:03:40.855785 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 05:03:40.855785 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 05:03:40.855785 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 05:03:40.855785 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 05:03:40.855785 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 05:03:40.855785 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 05:03:40.855785 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 05:03:40.855785 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a2aa4b1-2fd2-45e4-a058-71f0855e48c0 could not be found. Jul 30 05:03:40.855785 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:03:40.855785 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 05:03:40.855785 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:03:40.855785 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:03:40.855785 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 05:03:40.855785 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 05:03:40.855785 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 05:03:40.855785 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 05:03:40.855785 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 05:03:40.857933 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 05:03:40.857933 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 05:03:40.857933 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 05:03:40.857933 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 05:03:40.857933 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 05:03:40.857933 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 05:03:40.857933 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 05:03:40.857933 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a2aa4b1-2fd2-45e4-a058-71f0855e48c0 could not be found. Jul 30 05:03:40.857933 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:03:40.857933 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 05:03:40.857933 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:03:40.857933 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:03:40.857933 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 05:03:40.857933 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 05:03:40.857933 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 05:03:40.857933 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 05:03:40.857933 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a2aa4b1-2fd2-45e4-a058-71f0855e48c0 could not be found. Jul 30 05:03:40.857933 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:03:40.860577 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-2c9aef97-f520-4ac8-8ccc-e626829b1051 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Returning 404 to user: Instance 0a2aa4b1-2fd2-45e4-a058-71f0855e48c0 could not be found. {{(pid=117885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 05:03:40.862335 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-2c9aef97-f520-4ac8-8ccc-e626829b1051 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/0a2aa4b1-2fd2-45e4-a058-71f0855e48c0" status: 404 len: 111 microversion: 2.1 time: 0.072967 Jul 30 05:03:40.863890 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 380/799] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:03:40 2022] GET /compute/v2.1/servers/0a2aa4b1-2fd2-45e4-a058-71f0855e48c0 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 05:03:40.872568 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-de88ff46-ae55-4d21-930c-515e4c32e1d1 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '.version_select at 0x7f2daf6e9550>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:40.902177 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-f2c699a3-cd6d-4ffe-822b-b5a331b28a69 req-abfa9082-a76a-4e85-8fec-1baec4ace362 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b5e218d-8660-4d90-90d1-9c8e50a66a7c", "name": "network-vif-deleted", "tag": "46f49659-6b94-4d15-9602-46c795a35ee9"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:03:40.913092 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-de88ff46-ae55-4d21-930c-515e4c32e1d1 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-887792003" status: 202 len: 0 microversion: 2.1 time: 0.044328 Jul 30 05:03:40.913682 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 420/800] 10.222.0.20 () {58 vars in 1218 bytes} [Sat Jul 30 05:03:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-887792003 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 05:03:40.914666 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-f2c699a3-cd6d-4ffe-822b-b5a331b28a69 req-abfa9082-a76a-4e85-8fec-1baec4ace362 service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:40.915367 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-f2c699a3-cd6d-4ffe-822b-b5a331b28a69 req-abfa9082-a76a-4e85-8fec-1baec4ace362 service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:40.928624 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-f2c699a3-cd6d-4ffe-822b-b5a331b28a69 req-abfa9082-a76a-4e85-8fec-1baec4ace362 service nova] Creating event network-vif-deleted:46f49659-6b94-4d15-9602-46c795a35ee9 for instance 7b5e218d-8660-4d90-90d1-9c8e50a66a7c on hv-cinder-85127 Jul 30 05:03:40.934220 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-f2c699a3-cd6d-4ffe-822b-b5a331b28a69 req-abfa9082-a76a-4e85-8fec-1baec4ace362 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035644 Jul 30 05:03:40.935132 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 381/801] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Jul 30 05:03:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 05:03:41.076111 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-a24d4a03-3711-4f07-a3de-abff9da778c2 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:41.076835 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-a24d4a03-3711-4f07-a3de-abff9da778c2 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] [instance: 0faad1c9-0b0d-44af-92cb-dd0acd61c755] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:41.090484 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a24d4a03-3711-4f07-a3de-abff9da778c2 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:41.090950 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a24d4a03-3711-4f07-a3de-abff9da778c2 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:41.091985 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a24d4a03-3711-4f07-a3de-abff9da778c2 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:41.098530 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a24d4a03-3711-4f07-a3de-abff9da778c2 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:41.103435 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:03:41.200302 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-a24d4a03-3711-4f07-a3de-abff9da778c2 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42d3708ddfcc491cb366054dcd5f8881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abbb209e2c194596bb3e8b9a6880646e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:41.217034 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-a24d4a03-3711-4f07-a3de-abff9da778c2 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] 10.222.0.20 "GET /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755" status: 200 len: 1315 microversion: 2.1 time: 0.145989 Jul 30 05:03:41.218771 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 421/802] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:03:41 2022] GET /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755 => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:03:41.416965 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-9f5967bc-784f-427d-a248-75bb82043efd tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:41.417659 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-9f5967bc-784f-427d-a248-75bb82043efd tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] [instance: 99b497c8-e641-428a-94b6-86c21af5844f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:41.426318 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9f5967bc-784f-427d-a248-75bb82043efd tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:41.430001 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9f5967bc-784f-427d-a248-75bb82043efd tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:41.431250 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9f5967bc-784f-427d-a248-75bb82043efd tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:41.432542 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9f5967bc-784f-427d-a248-75bb82043efd tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:41.742671 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-9f5967bc-784f-427d-a248-75bb82043efd tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a98edf8e5a4a22b3ae7d041b582b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76df23454a3c4a9bb4f61b044ed5a426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:41.750809 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-9f5967bc-784f-427d-a248-75bb82043efd tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] 10.222.0.20 "GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f" status: 200 len: 1570 microversion: 2.1 time: 0.337961 Jul 30 05:03:41.759748 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 382/803] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:03:41 2022] GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f => generated 1570 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:03:41.798512 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-626cd703-aefa-45ff-a57f-74b609345060 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:41.801627 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-626cd703-aefa-45ff-a57f-74b609345060 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 7b5e218d-8660-4d90-90d1-9c8e50a66a7c] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:41.815850 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-626cd703-aefa-45ff-a57f-74b609345060 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:41.816594 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-626cd703-aefa-45ff-a57f-74b609345060 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:41.825058 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-626cd703-aefa-45ff-a57f-74b609345060 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:41.825836 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-626cd703-aefa-45ff-a57f-74b609345060 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:41.932790 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-626cd703-aefa-45ff-a57f-74b609345060 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:41.941651 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-626cd703-aefa-45ff-a57f-74b609345060 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c" status: 200 len: 1466 microversion: 2.1 time: 0.148157 Jul 30 05:03:41.957887 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 422/804] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:03:41 2022] GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c => generated 1466 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:03:42.044346 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-bfd25b98-70b4-489b-b931-d9f7ee10252a tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Action: 'create', calling method: .version_select at 0x7f2daf7534c0>, body: {"keypair": {"name": "tempest-keypair-1410911187", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLmW9SuEX0QHY1/hbt4bf22jtA16S/W6FH7u3z/Mqk5/64Dc9GJqqOIfYcaACYoWDJlrU4nBT+dq4CV/wBcD0ukCS9jSZiH7mEsBFAIPpTv+IJNWjgP07xauTDHKsQdcIQ=="}} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:03:42.061186 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.quota [None req-bfd25b98-70b4-489b-b931-d9f7ee10252a tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Getting quotas for project e01500cb03c74d1082090cd1c1836169. Resources: {'key_pairs'} {{(pid=117885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 05:03:42.065329 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.quota [None req-bfd25b98-70b4-489b-b931-d9f7ee10252a tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Getting quotas for user a8abb58f9c274e568d2d0fe3d4df11de and project e01500cb03c74d1082090cd1c1836169. Resources: {'key_pairs'} {{(pid=117885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 05:03:42.090360 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-bfd25b98-70b4-489b-b931-d9f7ee10252a tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.049789 Jul 30 05:03:42.096437 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 383/805] 10.222.0.20 () {60 vars in 1159 bytes} [Sat Jul 30 05:03:42 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 05:03:42.242100 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-0f00139f-a0e5-4c36-b63f-edba8246107a tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:42.243086 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-0f00139f-a0e5-4c36-b63f-edba8246107a tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] [instance: 0faad1c9-0b0d-44af-92cb-dd0acd61c755] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:42.249874 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0f00139f-a0e5-4c36-b63f-edba8246107a tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:42.250416 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0f00139f-a0e5-4c36-b63f-edba8246107a tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:42.251342 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0f00139f-a0e5-4c36-b63f-edba8246107a tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:42.251919 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0f00139f-a0e5-4c36-b63f-edba8246107a tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:42.437548 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-0f00139f-a0e5-4c36-b63f-edba8246107a tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42d3708ddfcc491cb366054dcd5f8881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abbb209e2c194596bb3e8b9a6880646e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:42.447654 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-0f00139f-a0e5-4c36-b63f-edba8246107a tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] 10.222.0.20 "GET /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755" status: 200 len: 1357 microversion: 2.1 time: 0.209772 Jul 30 05:03:42.448242 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 423/806] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:03:42 2022] GET /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755 => generated 1357 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 05:03:42.779670 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-f6081580-92fa-4b5e-9299-15622f251f0e tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:42.780641 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-f6081580-92fa-4b5e-9299-15622f251f0e tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] [instance: 99b497c8-e641-428a-94b6-86c21af5844f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:42.794148 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f6081580-92fa-4b5e-9299-15622f251f0e tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:42.794659 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f6081580-92fa-4b5e-9299-15622f251f0e tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:42.795728 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f6081580-92fa-4b5e-9299-15622f251f0e tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:42.796315 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f6081580-92fa-4b5e-9299-15622f251f0e tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:42.964952 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-f6081580-92fa-4b5e-9299-15622f251f0e tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a98edf8e5a4a22b3ae7d041b582b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76df23454a3c4a9bb4f61b044ed5a426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:42.966782 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-9b3e05e3-66ef-4aba-8f55-a45a623e228b tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:42.968912 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-9b3e05e3-66ef-4aba-8f55-a45a623e228b tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 7b5e218d-8660-4d90-90d1-9c8e50a66a7c] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:42.985016 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-f6081580-92fa-4b5e-9299-15622f251f0e tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] 10.222.0.20 "GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f" status: 200 len: 1570 microversion: 2.1 time: 0.209435 Jul 30 05:03:42.988459 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9b3e05e3-66ef-4aba-8f55-a45a623e228b tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:42.989160 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9b3e05e3-66ef-4aba-8f55-a45a623e228b tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:42.990169 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 384/807] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:03:42 2022] GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f => generated 1570 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:03:42.990360 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9b3e05e3-66ef-4aba-8f55-a45a623e228b tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:42.990987 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9b3e05e3-66ef-4aba-8f55-a45a623e228b tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:43.119423 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-9b3e05e3-66ef-4aba-8f55-a45a623e228b tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:43.126948 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-9b3e05e3-66ef-4aba-8f55-a45a623e228b tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c" status: 200 len: 1466 microversion: 2.1 time: 0.164743 Jul 30 05:03:43.127520 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 424/808] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:03:42 2022] GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c => generated 1466 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 05:03:43.478288 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-be9515ce-f51f-479b-9387-5a4419d8ecc4 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:43.478904 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-be9515ce-f51f-479b-9387-5a4419d8ecc4 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] [instance: 0faad1c9-0b0d-44af-92cb-dd0acd61c755] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:43.492409 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-be9515ce-f51f-479b-9387-5a4419d8ecc4 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:43.492871 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-be9515ce-f51f-479b-9387-5a4419d8ecc4 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:43.493630 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-be9515ce-f51f-479b-9387-5a4419d8ecc4 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:43.494067 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-be9515ce-f51f-479b-9387-5a4419d8ecc4 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:43.648100 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-9c85e15d-43e0-42d8-b9d4-dfaa6896eec3 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-912637883", "imageRef": "d6a9c8e1-ecb9-4603-bb88-2b0d46ac2387", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "afd82f39-2725-4de8-bc03-d4d225abc92e"}], "security_groups": [{"name": "tempest-securitygroup--1374345473"}], "key_name": "tempest-keypair-1410911187", "user_data": "}} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:03:43.652989 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-be9515ce-f51f-479b-9387-5a4419d8ecc4 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42d3708ddfcc491cb366054dcd5f8881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abbb209e2c194596bb3e8b9a6880646e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:43.668900 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-be9515ce-f51f-479b-9387-5a4419d8ecc4 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] 10.222.0.20 "GET /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755" status: 200 len: 1357 microversion: 2.1 time: 0.195030 Jul 30 05:03:43.670246 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 385/809] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:03:43 2022] GET /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755 => generated 1357 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:03:43.776542 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.network.neutron [None req-9c85e15d-43e0-42d8-b9d4-dfaa6896eec3 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] validate_networks() for [('afd82f39-2725-4de8-bc03-d4d225abc92e', None, None, None, None, None)] {{(pid=117886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 05:03:44.008974 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-4b6da4bb-de23-401a-9fd2-f259e4daa179 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:44.009617 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-4b6da4bb-de23-401a-9fd2-f259e4daa179 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] [instance: 99b497c8-e641-428a-94b6-86c21af5844f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:44.015716 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4b6da4bb-de23-401a-9fd2-f259e4daa179 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:44.016164 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4b6da4bb-de23-401a-9fd2-f259e4daa179 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:44.016956 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4b6da4bb-de23-401a-9fd2-f259e4daa179 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:44.017392 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4b6da4bb-de23-401a-9fd2-f259e4daa179 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:44.204240 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-9c85e15d-43e0-42d8-b9d4-dfaa6896eec3 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Flavor limits 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 05:03:44.208292 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-4b6da4bb-de23-401a-9fd2-f259e4daa179 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a98edf8e5a4a22b3ae7d041b582b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76df23454a3c4a9bb4f61b044ed5a426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:44.209123 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-9c85e15d-43e0-42d8-b9d4-dfaa6896eec3 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Image limits 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 05:03:44.212373 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-9c85e15d-43e0-42d8-b9d4-dfaa6896eec3 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Flavor pref 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 05:03:44.212995 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-9c85e15d-43e0-42d8-b9d4-dfaa6896eec3 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Image pref 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 05:03:44.213584 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-9c85e15d-43e0-42d8-b9d4-dfaa6896eec3 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 05:03:44.226716 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-4b6da4bb-de23-401a-9fd2-f259e4daa179 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] 10.222.0.20 "GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f" status: 200 len: 1570 microversion: 2.1 time: 0.221611 Jul 30 05:03:44.229353 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 386/810] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:03:44 2022] GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f => generated 1570 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 05:03:44.234252 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-d0aff09b-2795-4aa0-9d6a-88e2913edaa7 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:44.235229 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-d0aff09b-2795-4aa0-9d6a-88e2913edaa7 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 7b5e218d-8660-4d90-90d1-9c8e50a66a7c] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:44.245786 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9c85e15d-43e0-42d8-b9d4-dfaa6896eec3 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:44.247327 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9c85e15d-43e0-42d8-b9d4-dfaa6896eec3 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:44.248722 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9c85e15d-43e0-42d8-b9d4-dfaa6896eec3 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:44.249210 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9c85e15d-43e0-42d8-b9d4-dfaa6896eec3 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:44.257305 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d0aff09b-2795-4aa0-9d6a-88e2913edaa7 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:44.258144 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d0aff09b-2795-4aa0-9d6a-88e2913edaa7 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:44.259174 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d0aff09b-2795-4aa0-9d6a-88e2913edaa7 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:44.264945 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d0aff09b-2795-4aa0-9d6a-88e2913edaa7 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:44.291684 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.quota [None req-9c85e15d-43e0-42d8-b9d4-dfaa6896eec3 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Getting quotas for project e01500cb03c74d1082090cd1c1836169. Resources: {'ram', 'cores', 'instances'} {{(pid=117886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 05:03:44.306305 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.quota [None req-9c85e15d-43e0-42d8-b9d4-dfaa6896eec3 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Getting quotas for user a8abb58f9c274e568d2d0fe3d4df11de and project e01500cb03c74d1082090cd1c1836169. Resources: {'ram', 'cores', 'instances'} {{(pid=117886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 05:03:44.322506 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-9c85e15d-43e0-42d8-b9d4-dfaa6896eec3 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Going to run 1 instances... {{(pid=117886) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 05:03:44.325048 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-9c85e15d-43e0-42d8-b9d4-dfaa6896eec3 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: 40ede213-15fc-4a6c-bec6-eef18aae6b87] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d6a9c8e1-ecb9-4603-bb88-2b0d46ac2387',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 05:03:44.340011 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-d0aff09b-2795-4aa0-9d6a-88e2913edaa7 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:44.348418 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-d0aff09b-2795-4aa0-9d6a-88e2913edaa7 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c" status: 200 len: 1466 microversion: 2.1 time: 0.117834 Jul 30 05:03:44.348615 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:03:44.350615 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 387/811] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:03:44 2022] GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c => generated 1466 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:03:44.380982 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-9c85e15d-43e0-42d8-b9d4-dfaa6896eec3 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.737222 Jul 30 05:03:44.390867 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 425/812] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Jul 30 05:03:43 2022] POST /compute/v2.1/servers => generated 402 bytes in 749 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 30 05:03:44.394112 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-88d51fb2-201b-4c7c-8a0e-fdbce02cee99 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:44.394789 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-88d51fb2-201b-4c7c-8a0e-fdbce02cee99 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: 40ede213-15fc-4a6c-bec6-eef18aae6b87] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:44.501660 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-88d51fb2-201b-4c7c-8a0e-fdbce02cee99 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8abb58f9c274e568d2d0fe3d4df11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01500cb03c74d1082090cd1c1836169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:44.508877 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-88d51fb2-201b-4c7c-8a0e-fdbce02cee99 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/40ede213-15fc-4a6c-bec6-eef18aae6b87" status: 200 len: 1241 microversion: 2.1 time: 0.119091 Jul 30 05:03:44.509660 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 388/813] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:03:44 2022] GET /compute/v2.1/servers/40ede213-15fc-4a6c-bec6-eef18aae6b87 => generated 1241 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:03:44.692315 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-c84d1a34-2bed-43e3-8ef2-f8e1b8c46e17 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:44.693318 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-c84d1a34-2bed-43e3-8ef2-f8e1b8c46e17 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] [instance: 0faad1c9-0b0d-44af-92cb-dd0acd61c755] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:44.699933 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c84d1a34-2bed-43e3-8ef2-f8e1b8c46e17 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:44.700517 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c84d1a34-2bed-43e3-8ef2-f8e1b8c46e17 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:44.701392 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c84d1a34-2bed-43e3-8ef2-f8e1b8c46e17 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:44.701948 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c84d1a34-2bed-43e3-8ef2-f8e1b8c46e17 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:44.859701 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-c84d1a34-2bed-43e3-8ef2-f8e1b8c46e17 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42d3708ddfcc491cb366054dcd5f8881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abbb209e2c194596bb3e8b9a6880646e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:44.869691 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-c84d1a34-2bed-43e3-8ef2-f8e1b8c46e17 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] 10.222.0.20 "GET /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755" status: 200 len: 1357 microversion: 2.1 time: 0.181851 Jul 30 05:03:44.870641 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 426/814] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:03:44 2022] GET /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755 => generated 1357 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:03:45.249139 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-2ffc8722-b4c3-4182-af53-6fa483ba9269 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:45.249755 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-2ffc8722-b4c3-4182-af53-6fa483ba9269 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] [instance: 99b497c8-e641-428a-94b6-86c21af5844f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:45.257489 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2ffc8722-b4c3-4182-af53-6fa483ba9269 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:45.257938 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2ffc8722-b4c3-4182-af53-6fa483ba9269 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:45.258741 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2ffc8722-b4c3-4182-af53-6fa483ba9269 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:45.259358 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2ffc8722-b4c3-4182-af53-6fa483ba9269 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:45.374884 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-c180b169-7461-4f3e-9644-d5cd6d947550 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:45.376199 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-c180b169-7461-4f3e-9644-d5cd6d947550 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 7b5e218d-8660-4d90-90d1-9c8e50a66a7c] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:45.385775 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c180b169-7461-4f3e-9644-d5cd6d947550 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:45.386649 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c180b169-7461-4f3e-9644-d5cd6d947550 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:45.399641 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c180b169-7461-4f3e-9644-d5cd6d947550 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:45.400093 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c180b169-7461-4f3e-9644-d5cd6d947550 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:45.417159 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-2ffc8722-b4c3-4182-af53-6fa483ba9269 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a98edf8e5a4a22b3ae7d041b582b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76df23454a3c4a9bb4f61b044ed5a426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:45.425896 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-2ffc8722-b4c3-4182-af53-6fa483ba9269 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] 10.222.0.20 "GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f" status: 200 len: 1570 microversion: 2.1 time: 0.180250 Jul 30 05:03:45.427172 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 389/815] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:03:45 2022] GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f => generated 1570 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:03:45.477064 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-c180b169-7461-4f3e-9644-d5cd6d947550 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:45.484857 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-c180b169-7461-4f3e-9644-d5cd6d947550 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c" status: 200 len: 1466 microversion: 2.1 time: 0.113731 Jul 30 05:03:45.485555 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 427/816] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:03:45 2022] GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c => generated 1466 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:03:45.530309 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-0fb9f9a6-6974-4528-9c3d-be33d04f1c39 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:45.530946 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-0fb9f9a6-6974-4528-9c3d-be33d04f1c39 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: 40ede213-15fc-4a6c-bec6-eef18aae6b87] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:45.538047 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0fb9f9a6-6974-4528-9c3d-be33d04f1c39 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:45.538521 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0fb9f9a6-6974-4528-9c3d-be33d04f1c39 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:45.539293 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0fb9f9a6-6974-4528-9c3d-be33d04f1c39 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:45.539730 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0fb9f9a6-6974-4528-9c3d-be33d04f1c39 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:45.543984 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:03:45.608498 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-0fb9f9a6-6974-4528-9c3d-be33d04f1c39 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8abb58f9c274e568d2d0fe3d4df11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01500cb03c74d1082090cd1c1836169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:45.616091 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-0fb9f9a6-6974-4528-9c3d-be33d04f1c39 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/40ede213-15fc-4a6c-bec6-eef18aae6b87" status: 200 len: 1245 microversion: 2.1 time: 0.089558 Jul 30 05:03:45.616653 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 390/817] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:03:45 2022] GET /compute/v2.1/servers/40ede213-15fc-4a6c-bec6-eef18aae6b87 => generated 1245 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:03:45.891499 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-58081815-4f56-42bf-bd36-38aa2338147e tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:45.892594 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-58081815-4f56-42bf-bd36-38aa2338147e tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] [instance: 0faad1c9-0b0d-44af-92cb-dd0acd61c755] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:45.899208 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-58081815-4f56-42bf-bd36-38aa2338147e tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:45.899674 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-58081815-4f56-42bf-bd36-38aa2338147e tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:45.900440 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-58081815-4f56-42bf-bd36-38aa2338147e tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:45.900879 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-58081815-4f56-42bf-bd36-38aa2338147e tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:46.040703 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-58081815-4f56-42bf-bd36-38aa2338147e tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42d3708ddfcc491cb366054dcd5f8881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abbb209e2c194596bb3e8b9a6880646e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:46.050572 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-58081815-4f56-42bf-bd36-38aa2338147e tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] 10.222.0.20 "GET /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755" status: 200 len: 1357 microversion: 2.1 time: 0.162819 Jul 30 05:03:46.054775 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 428/818] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:03:45 2022] GET /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755 => generated 1357 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:03:46.450798 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-d0467ebf-da22-47c0-8981-11a950ca1ac7 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:46.451696 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-d0467ebf-da22-47c0-8981-11a950ca1ac7 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] [instance: 99b497c8-e641-428a-94b6-86c21af5844f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:46.460404 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d0467ebf-da22-47c0-8981-11a950ca1ac7 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:46.460857 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d0467ebf-da22-47c0-8981-11a950ca1ac7 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:46.461674 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d0467ebf-da22-47c0-8981-11a950ca1ac7 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:46.462121 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d0467ebf-da22-47c0-8981-11a950ca1ac7 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:46.506319 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-fd973ea0-0ac7-438d-9459-7bc737c6b07d tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:46.506982 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-fd973ea0-0ac7-438d-9459-7bc737c6b07d tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 7b5e218d-8660-4d90-90d1-9c8e50a66a7c] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:46.513771 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fd973ea0-0ac7-438d-9459-7bc737c6b07d tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:46.514228 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fd973ea0-0ac7-438d-9459-7bc737c6b07d tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:46.515027 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fd973ea0-0ac7-438d-9459-7bc737c6b07d tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:46.515974 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fd973ea0-0ac7-438d-9459-7bc737c6b07d tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:46.612446 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-fd973ea0-0ac7-438d-9459-7bc737c6b07d tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:46.620449 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-fd973ea0-0ac7-438d-9459-7bc737c6b07d tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c" status: 200 len: 1466 microversion: 2.1 time: 0.118172 Jul 30 05:03:46.621009 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 429/819] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:03:46 2022] GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c => generated 1466 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:03:46.622736 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-d0467ebf-da22-47c0-8981-11a950ca1ac7 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a98edf8e5a4a22b3ae7d041b582b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76df23454a3c4a9bb4f61b044ed5a426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:46.631667 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-d0467ebf-da22-47c0-8981-11a950ca1ac7 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] 10.222.0.20 "GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f" status: 200 len: 1570 microversion: 2.1 time: 0.185013 Jul 30 05:03:46.641187 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-56ea8901-de31-48e2-984d-676fcc643cf2 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:46.642390 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-56ea8901-de31-48e2-984d-676fcc643cf2 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: 40ede213-15fc-4a6c-bec6-eef18aae6b87] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:46.642895 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 391/820] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:03:46 2022] GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f => generated 1570 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:03:46.650668 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-56ea8901-de31-48e2-984d-676fcc643cf2 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:46.651121 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-56ea8901-de31-48e2-984d-676fcc643cf2 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:46.651928 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-56ea8901-de31-48e2-984d-676fcc643cf2 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:46.652363 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-56ea8901-de31-48e2-984d-676fcc643cf2 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:46.717566 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-56ea8901-de31-48e2-984d-676fcc643cf2 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8abb58f9c274e568d2d0fe3d4df11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01500cb03c74d1082090cd1c1836169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:46.726366 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-56ea8901-de31-48e2-984d-676fcc643cf2 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/40ede213-15fc-4a6c-bec6-eef18aae6b87" status: 200 len: 1245 microversion: 2.1 time: 0.089044 Jul 30 05:03:46.727168 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 430/821] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:03:46 2022] GET /compute/v2.1/servers/40ede213-15fc-4a6c-bec6-eef18aae6b87 => generated 1245 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:03:47.070825 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-ee5e01f3-6280-432b-bb67-59388d8b92f0 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:47.071446 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-ee5e01f3-6280-432b-bb67-59388d8b92f0 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] [instance: 0faad1c9-0b0d-44af-92cb-dd0acd61c755] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:47.077695 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ee5e01f3-6280-432b-bb67-59388d8b92f0 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:47.078152 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ee5e01f3-6280-432b-bb67-59388d8b92f0 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:47.078969 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ee5e01f3-6280-432b-bb67-59388d8b92f0 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:47.079414 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ee5e01f3-6280-432b-bb67-59388d8b92f0 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:47.218017 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-ee5e01f3-6280-432b-bb67-59388d8b92f0 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42d3708ddfcc491cb366054dcd5f8881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abbb209e2c194596bb3e8b9a6880646e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:47.226609 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-ee5e01f3-6280-432b-bb67-59388d8b92f0 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] 10.222.0.20 "GET /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755" status: 200 len: 1357 microversion: 2.1 time: 0.159491 Jul 30 05:03:47.230628 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 392/822] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:03:47 2022] GET /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755 => generated 1357 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:03:47.644519 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-699cd407-8c80-43ad-878f-9d5ca06b7a67 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:47.645168 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-699cd407-8c80-43ad-878f-9d5ca06b7a67 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 7b5e218d-8660-4d90-90d1-9c8e50a66a7c] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:47.652029 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-699cd407-8c80-43ad-878f-9d5ca06b7a67 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:47.652618 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-699cd407-8c80-43ad-878f-9d5ca06b7a67 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:47.653321 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-12cfdc10-c084-43c6-b763-aa9d8273adaf tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:47.653884 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-699cd407-8c80-43ad-878f-9d5ca06b7a67 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:47.653884 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-699cd407-8c80-43ad-878f-9d5ca06b7a67 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:47.654594 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-12cfdc10-c084-43c6-b763-aa9d8273adaf tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] [instance: 99b497c8-e641-428a-94b6-86c21af5844f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:47.677960 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-12cfdc10-c084-43c6-b763-aa9d8273adaf tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:47.678541 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-12cfdc10-c084-43c6-b763-aa9d8273adaf tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:47.679403 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-12cfdc10-c084-43c6-b763-aa9d8273adaf tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:47.679912 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-12cfdc10-c084-43c6-b763-aa9d8273adaf tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:47.722751 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-699cd407-8c80-43ad-878f-9d5ca06b7a67 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:47.737737 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-699cd407-8c80-43ad-878f-9d5ca06b7a67 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c" status: 200 len: 1466 microversion: 2.1 time: 0.097727 Jul 30 05:03:47.748767 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 431/823] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:03:47 2022] GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c => generated 1466 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:03:47.754094 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-3f1de4f0-10dc-44dd-929e-4bc166f27969 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:47.754745 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-3f1de4f0-10dc-44dd-929e-4bc166f27969 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: 40ede213-15fc-4a6c-bec6-eef18aae6b87] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:47.761023 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3f1de4f0-10dc-44dd-929e-4bc166f27969 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:47.761724 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3f1de4f0-10dc-44dd-929e-4bc166f27969 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:47.762841 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3f1de4f0-10dc-44dd-929e-4bc166f27969 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:47.763446 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3f1de4f0-10dc-44dd-929e-4bc166f27969 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:47.837247 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-12cfdc10-c084-43c6-b763-aa9d8273adaf tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a98edf8e5a4a22b3ae7d041b582b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76df23454a3c4a9bb4f61b044ed5a426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:47.846367 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-12cfdc10-c084-43c6-b763-aa9d8273adaf tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] 10.222.0.20 "GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f" status: 200 len: 1570 microversion: 2.1 time: 0.197076 Jul 30 05:03:47.847166 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 393/824] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:03:47 2022] GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f => generated 1570 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 05:03:47.848081 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-3f1de4f0-10dc-44dd-929e-4bc166f27969 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8abb58f9c274e568d2d0fe3d4df11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01500cb03c74d1082090cd1c1836169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:47.855989 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-3f1de4f0-10dc-44dd-929e-4bc166f27969 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/40ede213-15fc-4a6c-bec6-eef18aae6b87" status: 200 len: 1245 microversion: 2.1 time: 0.105953 Jul 30 05:03:47.856721 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 432/825] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:03:47 2022] GET /compute/v2.1/servers/40ede213-15fc-4a6c-bec6-eef18aae6b87 => generated 1245 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:03:48.249504 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-d9256a65-d1c0-4deb-bb50-57fcdd207ef7 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:48.250321 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-d9256a65-d1c0-4deb-bb50-57fcdd207ef7 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] [instance: 0faad1c9-0b0d-44af-92cb-dd0acd61c755] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:48.256603 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d9256a65-d1c0-4deb-bb50-57fcdd207ef7 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:48.257118 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d9256a65-d1c0-4deb-bb50-57fcdd207ef7 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:48.265467 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d9256a65-d1c0-4deb-bb50-57fcdd207ef7 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:48.265930 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d9256a65-d1c0-4deb-bb50-57fcdd207ef7 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:48.404415 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-d9256a65-d1c0-4deb-bb50-57fcdd207ef7 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42d3708ddfcc491cb366054dcd5f8881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abbb209e2c194596bb3e8b9a6880646e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:48.412127 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-d9256a65-d1c0-4deb-bb50-57fcdd207ef7 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] 10.222.0.20 "GET /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755" status: 200 len: 1357 microversion: 2.1 time: 0.167592 Jul 30 05:03:48.412715 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 394/826] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:03:48 2022] GET /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755 => generated 1357 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:03:48.760501 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-82bcfd0a-ad43-413a-a80c-715b09208277 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:48.761114 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-82bcfd0a-ad43-413a-a80c-715b09208277 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 7b5e218d-8660-4d90-90d1-9c8e50a66a7c] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:48.767712 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-82bcfd0a-ad43-413a-a80c-715b09208277 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:48.768712 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-82bcfd0a-ad43-413a-a80c-715b09208277 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:48.769462 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-82bcfd0a-ad43-413a-a80c-715b09208277 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:48.769894 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-82bcfd0a-ad43-413a-a80c-715b09208277 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:48.831842 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-82bcfd0a-ad43-413a-a80c-715b09208277 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:48.839219 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-82bcfd0a-ad43-413a-a80c-715b09208277 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c" status: 200 len: 1466 microversion: 2.1 time: 0.082631 Jul 30 05:03:48.839783 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 433/827] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:03:48 2022] GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c => generated 1466 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:03:48.867964 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-e2f952f8-6f1a-495a-90ad-57999a19d628 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:48.868568 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-e2f952f8-6f1a-495a-90ad-57999a19d628 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] [instance: 99b497c8-e641-428a-94b6-86c21af5844f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:48.875248 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e2f952f8-6f1a-495a-90ad-57999a19d628 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:48.875697 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e2f952f8-6f1a-495a-90ad-57999a19d628 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:48.876464 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e2f952f8-6f1a-495a-90ad-57999a19d628 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:48.876735 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-a89accac-c3e6-4471-95cb-053e5be42232 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:48.876958 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e2f952f8-6f1a-495a-90ad-57999a19d628 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:48.877942 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-a89accac-c3e6-4471-95cb-053e5be42232 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: 40ede213-15fc-4a6c-bec6-eef18aae6b87] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:48.883891 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a89accac-c3e6-4471-95cb-053e5be42232 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:48.884344 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a89accac-c3e6-4471-95cb-053e5be42232 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:48.885111 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a89accac-c3e6-4471-95cb-053e5be42232 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:48.885548 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a89accac-c3e6-4471-95cb-053e5be42232 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:48.948708 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-a89accac-c3e6-4471-95cb-053e5be42232 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8abb58f9c274e568d2d0fe3d4df11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01500cb03c74d1082090cd1c1836169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:48.956710 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-a89accac-c3e6-4471-95cb-053e5be42232 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/40ede213-15fc-4a6c-bec6-eef18aae6b87" status: 200 len: 1245 microversion: 2.1 time: 0.083657 Jul 30 05:03:48.957291 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 434/828] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:03:48 2022] GET /compute/v2.1/servers/40ede213-15fc-4a6c-bec6-eef18aae6b87 => generated 1245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 05:03:49.012384 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-e2f952f8-6f1a-495a-90ad-57999a19d628 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a98edf8e5a4a22b3ae7d041b582b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76df23454a3c4a9bb4f61b044ed5a426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:49.020206 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-e2f952f8-6f1a-495a-90ad-57999a19d628 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] 10.222.0.20 "GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f" status: 200 len: 1570 microversion: 2.1 time: 0.155977 Jul 30 05:03:49.020696 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 395/829] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:03:48 2022] GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:03:49.433105 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-9e933e19-da4d-4ea7-9a11-ef5d012ebf87 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:49.433726 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-9e933e19-da4d-4ea7-9a11-ef5d012ebf87 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] [instance: 0faad1c9-0b0d-44af-92cb-dd0acd61c755] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:49.440126 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9e933e19-da4d-4ea7-9a11-ef5d012ebf87 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:49.440673 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9e933e19-da4d-4ea7-9a11-ef5d012ebf87 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:49.441454 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9e933e19-da4d-4ea7-9a11-ef5d012ebf87 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:49.441899 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9e933e19-da4d-4ea7-9a11-ef5d012ebf87 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:49.577078 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-9e933e19-da4d-4ea7-9a11-ef5d012ebf87 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42d3708ddfcc491cb366054dcd5f8881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abbb209e2c194596bb3e8b9a6880646e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:49.585673 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-9e933e19-da4d-4ea7-9a11-ef5d012ebf87 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] 10.222.0.20 "GET /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755" status: 200 len: 1357 microversion: 2.1 time: 0.156390 Jul 30 05:03:49.586240 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 435/830] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:03:49 2022] GET /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755 => generated 1357 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:03:49.862883 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-05fcf38f-ee93-46ff-bd2c-fc6379936d19 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:49.863414 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-05fcf38f-ee93-46ff-bd2c-fc6379936d19 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 7b5e218d-8660-4d90-90d1-9c8e50a66a7c] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:49.875903 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-05fcf38f-ee93-46ff-bd2c-fc6379936d19 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:49.876571 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-05fcf38f-ee93-46ff-bd2c-fc6379936d19 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:49.878149 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-05fcf38f-ee93-46ff-bd2c-fc6379936d19 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:49.878474 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-05fcf38f-ee93-46ff-bd2c-fc6379936d19 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:49.988413 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-05fcf38f-ee93-46ff-bd2c-fc6379936d19 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:49.994638 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-b3d5dc7f-3994-4a4e-ada4-fa58edae4d22 req-6fa27a6f-be16-4f4c-972a-8b7f2e2e7c64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0faad1c9-0b0d-44af-92cb-dd0acd61c755", "tag": "abedbf31-d88b-46bc-a1ef-33a68dcc3b21"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:03:49.998792 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-05fcf38f-ee93-46ff-bd2c-fc6379936d19 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c" status: 200 len: 1293 microversion: 2.1 time: 0.139544 Jul 30 05:03:50.010566 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 396/831] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:03:49 2022] GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c => generated 1293 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:03:50.010566 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-1d71a220-ea5d-4ea3-b793-a4b55c305c6d tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:50.010566 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-1d71a220-ea5d-4ea3-b793-a4b55c305c6d tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: 40ede213-15fc-4a6c-bec6-eef18aae6b87] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:50.014114 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1d71a220-ea5d-4ea3-b793-a4b55c305c6d tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:50.014114 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1d71a220-ea5d-4ea3-b793-a4b55c305c6d tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:50.014114 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1d71a220-ea5d-4ea3-b793-a4b55c305c6d tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:50.014415 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1d71a220-ea5d-4ea3-b793-a4b55c305c6d tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:50.026671 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-b3d5dc7f-3994-4a4e-ada4-fa58edae4d22 req-6fa27a6f-be16-4f4c-972a-8b7f2e2e7c64 service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:50.027120 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-b3d5dc7f-3994-4a4e-ada4-fa58edae4d22 req-6fa27a6f-be16-4f4c-972a-8b7f2e2e7c64 service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:50.040465 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-b3d5dc7f-3994-4a4e-ada4-fa58edae4d22 req-6fa27a6f-be16-4f4c-972a-8b7f2e2e7c64 service nova] Creating event network-changed:abedbf31-d88b-46bc-a1ef-33a68dcc3b21 for instance 0faad1c9-0b0d-44af-92cb-dd0acd61c755 on hv-cinder-85127 Jul 30 05:03:50.046117 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-b3d5dc7f-3994-4a4e-ada4-fa58edae4d22 req-6fa27a6f-be16-4f4c-972a-8b7f2e2e7c64 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131097 Jul 30 05:03:50.047075 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 436/832] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Jul 30 05:03:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 05:03:50.053019 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-304f4406-d0ba-4098-915c-50bd78e4469c tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:50.053728 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-304f4406-d0ba-4098-915c-50bd78e4469c tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] [instance: 99b497c8-e641-428a-94b6-86c21af5844f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:50.060806 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-304f4406-d0ba-4098-915c-50bd78e4469c tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:50.061269 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-304f4406-d0ba-4098-915c-50bd78e4469c tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:50.062048 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-304f4406-d0ba-4098-915c-50bd78e4469c tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:50.062514 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-304f4406-d0ba-4098-915c-50bd78e4469c tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:50.200955 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-304f4406-d0ba-4098-915c-50bd78e4469c tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a98edf8e5a4a22b3ae7d041b582b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76df23454a3c4a9bb4f61b044ed5a426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:50.209795 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-304f4406-d0ba-4098-915c-50bd78e4469c tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] 10.222.0.20 "GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f" status: 200 len: 1570 microversion: 2.1 time: 0.161216 Jul 30 05:03:50.210323 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 437/833] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:03:50 2022] GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f => generated 1570 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:03:50.313793 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-1d71a220-ea5d-4ea3-b793-a4b55c305c6d tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8abb58f9c274e568d2d0fe3d4df11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01500cb03c74d1082090cd1c1836169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:50.324694 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-1d71a220-ea5d-4ea3-b793-a4b55c305c6d tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/40ede213-15fc-4a6c-bec6-eef18aae6b87" status: 200 len: 1237 microversion: 2.1 time: 0.324330 Jul 30 05:03:50.326330 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 397/834] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:03:49 2022] GET /compute/v2.1/servers/40ede213-15fc-4a6c-bec6-eef18aae6b87 => generated 1237 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:03:50.606818 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-fddc4e5b-48f7-42ab-bfca-28f025be9ad0 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:50.607505 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-fddc4e5b-48f7-42ab-bfca-28f025be9ad0 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] [instance: 0faad1c9-0b0d-44af-92cb-dd0acd61c755] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:50.626568 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fddc4e5b-48f7-42ab-bfca-28f025be9ad0 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:50.627155 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fddc4e5b-48f7-42ab-bfca-28f025be9ad0 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:50.627940 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fddc4e5b-48f7-42ab-bfca-28f025be9ad0 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:50.628380 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-fddc4e5b-48f7-42ab-bfca-28f025be9ad0 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:50.764613 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-fddc4e5b-48f7-42ab-bfca-28f025be9ad0 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42d3708ddfcc491cb366054dcd5f8881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abbb209e2c194596bb3e8b9a6880646e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:50.773465 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-fddc4e5b-48f7-42ab-bfca-28f025be9ad0 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] 10.222.0.20 "GET /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755" status: 200 len: 1357 microversion: 2.1 time: 0.171094 Jul 30 05:03:50.774048 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 438/835] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:03:50 2022] GET /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755 => generated 1357 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:03:51.021989 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-5340223e-44a2-4397-927d-c55eff8d0ff8 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:51.023230 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-5340223e-44a2-4397-927d-c55eff8d0ff8 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: 7b5e218d-8660-4d90-90d1-9c8e50a66a7c] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:51.030695 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5340223e-44a2-4397-927d-c55eff8d0ff8 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:51.031139 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5340223e-44a2-4397-927d-c55eff8d0ff8 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:51.032929 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5340223e-44a2-4397-927d-c55eff8d0ff8 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:51.033576 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5340223e-44a2-4397-927d-c55eff8d0ff8 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:51.047809 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.wsgi [None req-5340223e-44a2-4397-927d-c55eff8d0ff8 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] HTTP exception thrown: Instance 7b5e218d-8660-4d90-90d1-9c8e50a66a7c could not be found. Jul 30 05:03:51.049789 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-5340223e-44a2-4397-927d-c55eff8d0ff8 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Request method failure captured: Jul 30 05:03:51.049789 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: request: GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c HTTP/1.1 Jul 30 05:03:51.049789 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Accept: application/json Jul 30 05:03:51.049789 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Accept-Encoding: identity Jul 30 05:03:51.049789 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Connection: close Jul 30 05:03:51.049789 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Content-Length: 0 Jul 30 05:03:51.049789 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Content-Type: application/json Jul 30 05:03:51.049789 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Host: 10.222.0.20 Jul 30 05:03:51.049789 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Openstack-System-Scope: None Jul 30 05:03:51.049789 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: User-Agent: python-urllib3/1.26.10 Jul 30 05:03:51.049789 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Auth-Token: gAAAAABi5Lpu5KZ-sBOjkiuZTtNR2YWcqU_r-_-3UQQ04xAT-w7gK_BuaWmEOr5Ju1pwtkZZzl_OTo-ZEKY-uHmyReS4PYVQ4M2aEskgI5yNySqgQDIjC3jupbHgF4azyUEFhR8JjMfCOfjvUulaZeOLaDw7yo-4-VTWVyQqf3A9DFmnALqdkU8 Jul 30 05:03:51.049789 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Domain-Id: None Jul 30 05:03:51.049789 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Domain-Name: None Jul 30 05:03:51.049789 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Identity-Status: Confirmed Jul 30 05:03:51.049789 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Is-Admin-Project: True Jul 30 05:03:51.049789 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Domain-Id: default Jul 30 05:03:51.049789 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Domain-Name: Default Jul 30 05:03:51.049789 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Id: decb0bd64582440590890900e594b79e Jul 30 05:03:51.049789 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-243408600 Jul 30 05:03:51.049789 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Role: member,reader Jul 30 05:03:51.049789 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Roles: member,reader Jul 30 05:03:51.051268 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/decb0bd64582440590890900e594b79e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/decb0bd64582440590890900e594b79e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_decb0bd64582440590890900e594b79e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/decb0bd64582440590890900e594b79e"}]}] Jul 30 05:03:51.051268 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Tenant: tempest-ServerRescueNegativeTestJSON-243408600 Jul 30 05:03:51.051268 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Tenant-Id: decb0bd64582440590890900e594b79e Jul 30 05:03:51.051268 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-243408600 Jul 30 05:03:51.051268 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User: tempest-ServerRescueNegativeTestJSON-243408600-project Jul 30 05:03:51.051268 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Domain-Id: default Jul 30 05:03:51.051268 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Domain-Name: Default Jul 30 05:03:51.051268 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Id: 25db6f7402ae4a14a04fab0a9915ab77 Jul 30 05:03:51.051268 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Name: tempest-ServerRescueNegativeTestJSON-243408600-project Jul 30 05:03:51.051268 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: method: > Jul 30 05:03:51.051268 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: exception: Instance 7b5e218d-8660-4d90-90d1-9c8e50a66a7c could not be found. Jul 30 05:03:51.051268 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: action_args: {'id': '7b5e218d-8660-4d90-90d1-9c8e50a66a7c'} Jul 30 05:03:51.052048 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 05:03:51.052048 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:03:51.052048 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 05:03:51.052048 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 05:03:51.052048 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 05:03:51.052048 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 05:03:51.052048 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 05:03:51.052048 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 05:03:51.052048 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 05:03:51.052048 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 05:03:51.052048 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b5e218d-8660-4d90-90d1-9c8e50a66a7c could not be found. Jul 30 05:03:51.052048 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:03:51.052048 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 05:03:51.052048 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:03:51.052048 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:03:51.052048 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 05:03:51.052048 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 05:03:51.052048 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 05:03:51.052048 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 05:03:51.052048 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 05:03:51.053339 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 05:03:51.053339 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 05:03:51.053339 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 05:03:51.053339 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 05:03:51.053339 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 05:03:51.053339 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 05:03:51.053339 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 05:03:51.053339 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b5e218d-8660-4d90-90d1-9c8e50a66a7c could not be found. Jul 30 05:03:51.053339 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:03:51.053339 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 05:03:51.053339 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:03:51.053339 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:03:51.053339 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 05:03:51.053339 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 05:03:51.053339 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 05:03:51.053339 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 05:03:51.053339 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b5e218d-8660-4d90-90d1-9c8e50a66a7c could not be found. Jul 30 05:03:51.053339 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:03:51.054513 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-5340223e-44a2-4397-927d-c55eff8d0ff8 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Returning 404 to user: Instance 7b5e218d-8660-4d90-90d1-9c8e50a66a7c could not be found. {{(pid=117885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 05:03:51.054513 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-5340223e-44a2-4397-927d-c55eff8d0ff8 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c" status: 404 len: 111 microversion: 2.1 time: 0.033871 Jul 30 05:03:51.059766 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-37c03d0c-8478-4651-a6b4-5092f25661d0 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:51.060290 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 398/836] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:03:51 2022] GET /compute/v2.1/servers/7b5e218d-8660-4d90-90d1-9c8e50a66a7c => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 05:03:51.061181 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-37c03d0c-8478-4651-a6b4-5092f25661d0 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: cc0c06a0-156a-4cee-8ff7-92ab582bc4a1] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:51.068903 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-37c03d0c-8478-4651-a6b4-5092f25661d0 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:51.070025 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-37c03d0c-8478-4651-a6b4-5092f25661d0 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:51.071218 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-37c03d0c-8478-4651-a6b4-5092f25661d0 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:51.071815 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-37c03d0c-8478-4651-a6b4-5092f25661d0 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:51.076346 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=100 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:03:51.104252 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-37c03d0c-8478-4651-a6b4-5092f25661d0 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: cc0c06a0-156a-4cee-8ff7-92ab582bc4a1] Going to try to terminate instance {{(pid=117886) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 05:03:51.192631 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-37c03d0c-8478-4651-a6b4-5092f25661d0 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "DELETE /compute/v2.1/servers/cc0c06a0-156a-4cee-8ff7-92ab582bc4a1" status: 204 len: 0 microversion: 2.1 time: 0.135446 Jul 30 05:03:51.196891 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 439/837] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Jul 30 05:03:51 2022] DELETE /compute/v2.1/servers/cc0c06a0-156a-4cee-8ff7-92ab582bc4a1 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 05:03:51.202109 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-f0aee2cf-15e3-43d2-a043-a41a8aa1322a tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:51.202858 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-f0aee2cf-15e3-43d2-a043-a41a8aa1322a tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: cc0c06a0-156a-4cee-8ff7-92ab582bc4a1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:51.209788 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f0aee2cf-15e3-43d2-a043-a41a8aa1322a tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:51.210327 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f0aee2cf-15e3-43d2-a043-a41a8aa1322a tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:51.211218 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f0aee2cf-15e3-43d2-a043-a41a8aa1322a tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:51.211742 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f0aee2cf-15e3-43d2-a043-a41a8aa1322a tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:51.233154 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-7d020fd2-4173-4af9-859e-c219285dd77a tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:51.233856 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-7d020fd2-4173-4af9-859e-c219285dd77a tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] [instance: 99b497c8-e641-428a-94b6-86c21af5844f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:51.249839 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7d020fd2-4173-4af9-859e-c219285dd77a tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:51.250288 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7d020fd2-4173-4af9-859e-c219285dd77a tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:51.251090 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7d020fd2-4173-4af9-859e-c219285dd77a tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:51.251526 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7d020fd2-4173-4af9-859e-c219285dd77a tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:51.399871 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-7d020fd2-4173-4af9-859e-c219285dd77a tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a98edf8e5a4a22b3ae7d041b582b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76df23454a3c4a9bb4f61b044ed5a426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:51.407482 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-7d020fd2-4173-4af9-859e-c219285dd77a tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] 10.222.0.20 "GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f" status: 200 len: 1570 microversion: 2.1 time: 0.179634 Jul 30 05:03:51.408074 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 440/838] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:03:51 2022] GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f => generated 1570 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 05:03:51.412813 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-a9d35ee1-b7f9-4fe5-aeff-7f73e5b52d37 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:51.413560 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-a9d35ee1-b7f9-4fe5-aeff-7f73e5b52d37 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: 40ede213-15fc-4a6c-bec6-eef18aae6b87] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:51.421887 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a9d35ee1-b7f9-4fe5-aeff-7f73e5b52d37 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:51.422460 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a9d35ee1-b7f9-4fe5-aeff-7f73e5b52d37 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:51.423332 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a9d35ee1-b7f9-4fe5-aeff-7f73e5b52d37 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:51.424369 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a9d35ee1-b7f9-4fe5-aeff-7f73e5b52d37 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:51.445067 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-f0aee2cf-15e3-43d2-a043-a41a8aa1322a tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:51.453018 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-f0aee2cf-15e3-43d2-a043-a41a8aa1322a tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0c06a0-156a-4cee-8ff7-92ab582bc4a1" status: 200 len: 1523 microversion: 2.1 time: 0.255021 Jul 30 05:03:51.453677 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 399/839] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:03:51 2022] GET /compute/v2.1/servers/cc0c06a0-156a-4cee-8ff7-92ab582bc4a1 => generated 1523 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:03:51.488334 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-a9d35ee1-b7f9-4fe5-aeff-7f73e5b52d37 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8abb58f9c274e568d2d0fe3d4df11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01500cb03c74d1082090cd1c1836169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:51.496966 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-a9d35ee1-b7f9-4fe5-aeff-7f73e5b52d37 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/40ede213-15fc-4a6c-bec6-eef18aae6b87" status: 200 len: 1299 microversion: 2.1 time: 0.087543 Jul 30 05:03:51.497545 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 441/840] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:03:51 2022] GET /compute/v2.1/servers/40ede213-15fc-4a6c-bec6-eef18aae6b87 => generated 1299 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:03:51.794682 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-a60a9392-b934-467f-ac4d-2c2e01b27649 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:51.795549 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-a60a9392-b934-467f-ac4d-2c2e01b27649 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] [instance: 0faad1c9-0b0d-44af-92cb-dd0acd61c755] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:51.802100 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a60a9392-b934-467f-ac4d-2c2e01b27649 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:51.802579 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a60a9392-b934-467f-ac4d-2c2e01b27649 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:51.803374 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a60a9392-b934-467f-ac4d-2c2e01b27649 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:51.803815 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a60a9392-b934-467f-ac4d-2c2e01b27649 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:51.984840 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-a60a9392-b934-467f-ac4d-2c2e01b27649 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42d3708ddfcc491cb366054dcd5f8881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abbb209e2c194596bb3e8b9a6880646e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:51.993366 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-a60a9392-b934-467f-ac4d-2c2e01b27649 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] 10.222.0.20 "GET /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755" status: 200 len: 1357 microversion: 2.1 time: 0.202519 Jul 30 05:03:51.993937 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 400/841] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:03:51 2022] GET /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755 => generated 1357 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:03:52.429585 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-36df7de9-eeda-4a08-b4c0-d59d9d8d3146 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:52.430268 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-36df7de9-eeda-4a08-b4c0-d59d9d8d3146 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] [instance: 99b497c8-e641-428a-94b6-86c21af5844f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:52.436820 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-36df7de9-eeda-4a08-b4c0-d59d9d8d3146 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:52.437276 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-36df7de9-eeda-4a08-b4c0-d59d9d8d3146 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:52.438040 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-36df7de9-eeda-4a08-b4c0-d59d9d8d3146 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:52.438531 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-36df7de9-eeda-4a08-b4c0-d59d9d8d3146 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:52.475224 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-d1f2932c-cdda-4ada-9ff4-68509bfc72a1 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:52.475850 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-d1f2932c-cdda-4ada-9ff4-68509bfc72a1 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: cc0c06a0-156a-4cee-8ff7-92ab582bc4a1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:52.483356 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d1f2932c-cdda-4ada-9ff4-68509bfc72a1 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:52.484137 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d1f2932c-cdda-4ada-9ff4-68509bfc72a1 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:52.484937 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d1f2932c-cdda-4ada-9ff4-68509bfc72a1 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:52.485379 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d1f2932c-cdda-4ada-9ff4-68509bfc72a1 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:52.584024 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-36df7de9-eeda-4a08-b4c0-d59d9d8d3146 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a98edf8e5a4a22b3ae7d041b582b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76df23454a3c4a9bb4f61b044ed5a426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:52.591462 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-36df7de9-eeda-4a08-b4c0-d59d9d8d3146 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] 10.222.0.20 "GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f" status: 200 len: 1570 microversion: 2.1 time: 0.165906 Jul 30 05:03:52.592053 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 442/842] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:03:52 2022] GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f => generated 1570 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:03:52.596486 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-0a528ed4-6d3c-45b9-a273-47bc408352b3 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:52.597404 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-0a528ed4-6d3c-45b9-a273-47bc408352b3 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: 40ede213-15fc-4a6c-bec6-eef18aae6b87] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:52.608684 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0a528ed4-6d3c-45b9-a273-47bc408352b3 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:52.609177 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0a528ed4-6d3c-45b9-a273-47bc408352b3 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:52.610017 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0a528ed4-6d3c-45b9-a273-47bc408352b3 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:52.610655 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0a528ed4-6d3c-45b9-a273-47bc408352b3 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:52.667149 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-d1f2932c-cdda-4ada-9ff4-68509bfc72a1 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:52.675553 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-d1f2932c-cdda-4ada-9ff4-68509bfc72a1 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0c06a0-156a-4cee-8ff7-92ab582bc4a1" status: 200 len: 1523 microversion: 2.1 time: 0.204696 Jul 30 05:03:52.683416 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 401/843] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:03:52 2022] GET /compute/v2.1/servers/cc0c06a0-156a-4cee-8ff7-92ab582bc4a1 => generated 1523 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 05:03:52.683416 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-0f721852-a339-41c7-8619-6c3a6e303b47 req-c3ba6625-fdcd-442a-96bf-1d587667671c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40ede213-15fc-4a6c-bec6-eef18aae6b87", "tag": "71dbf2c2-385e-484d-a2ac-d51216c17d84"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:03:52.685704 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:03:52.692745 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-0f721852-a339-41c7-8619-6c3a6e303b47 req-c3ba6625-fdcd-442a-96bf-1d587667671c service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:52.693192 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-0f721852-a339-41c7-8619-6c3a6e303b47 req-c3ba6625-fdcd-442a-96bf-1d587667671c service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:52.706508 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-0f721852-a339-41c7-8619-6c3a6e303b47 req-c3ba6625-fdcd-442a-96bf-1d587667671c service nova] Creating event network-changed:71dbf2c2-385e-484d-a2ac-d51216c17d84 for instance 40ede213-15fc-4a6c-bec6-eef18aae6b87 on hv-cinder-85127 Jul 30 05:03:52.711421 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-0f721852-a339-41c7-8619-6c3a6e303b47 req-c3ba6625-fdcd-442a-96bf-1d587667671c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034243 Jul 30 05:03:52.712019 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 402/844] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Jul 30 05:03:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 05:03:52.748025 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-0a528ed4-6d3c-45b9-a273-47bc408352b3 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8abb58f9c274e568d2d0fe3d4df11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01500cb03c74d1082090cd1c1836169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:52.756098 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-0a528ed4-6d3c-45b9-a273-47bc408352b3 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/40ede213-15fc-4a6c-bec6-eef18aae6b87" status: 200 len: 1367 microversion: 2.1 time: 0.163081 Jul 30 05:03:52.756657 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 443/845] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:03:52 2022] GET /compute/v2.1/servers/40ede213-15fc-4a6c-bec6-eef18aae6b87 => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:03:53.015019 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-0b4542b7-15b8-4b0d-ba44-eacddbaf03fe tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:53.015751 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-0b4542b7-15b8-4b0d-ba44-eacddbaf03fe tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] [instance: 0faad1c9-0b0d-44af-92cb-dd0acd61c755] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:53.022945 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0b4542b7-15b8-4b0d-ba44-eacddbaf03fe tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:53.023405 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0b4542b7-15b8-4b0d-ba44-eacddbaf03fe tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:53.024652 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0b4542b7-15b8-4b0d-ba44-eacddbaf03fe tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:53.024652 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0b4542b7-15b8-4b0d-ba44-eacddbaf03fe tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:53.160502 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-0b4542b7-15b8-4b0d-ba44-eacddbaf03fe tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42d3708ddfcc491cb366054dcd5f8881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abbb209e2c194596bb3e8b9a6880646e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:53.168504 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-0b4542b7-15b8-4b0d-ba44-eacddbaf03fe tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] 10.222.0.20 "GET /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755" status: 200 len: 1357 microversion: 2.1 time: 0.157999 Jul 30 05:03:53.169093 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 403/846] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:03:53 2022] GET /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755 => generated 1357 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:03:53.443620 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-953926ad-217f-4bb5-89f2-0794922eada6 req-24bffcd1-fae3-45a6-9aa8-5c644b861c6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99b497c8-e641-428a-94b6-86c21af5844f", "name": "network-vif-plugged", "status": "completed", "tag": "1a76ab0f-eada-4891-8b4c-b2af44036eb1"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:03:53.453682 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-953926ad-217f-4bb5-89f2-0794922eada6 req-24bffcd1-fae3-45a6-9aa8-5c644b861c6d service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:53.454236 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-953926ad-217f-4bb5-89f2-0794922eada6 req-24bffcd1-fae3-45a6-9aa8-5c644b861c6d service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:53.466831 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-953926ad-217f-4bb5-89f2-0794922eada6 req-24bffcd1-fae3-45a6-9aa8-5c644b861c6d service nova] Creating event network-vif-plugged:1a76ab0f-eada-4891-8b4c-b2af44036eb1 for instance 99b497c8-e641-428a-94b6-86c21af5844f on hv-cinder-85127 Jul 30 05:03:53.472667 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-953926ad-217f-4bb5-89f2-0794922eada6 req-24bffcd1-fae3-45a6-9aa8-5c644b861c6d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033324 Jul 30 05:03:53.473347 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 444/847] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Jul 30 05:03:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 05:03:53.612699 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-8e0ccdf1-6132-4524-ace6-3dd2e26af4b1 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:53.613306 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-8e0ccdf1-6132-4524-ace6-3dd2e26af4b1 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] [instance: 99b497c8-e641-428a-94b6-86c21af5844f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:53.619796 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8e0ccdf1-6132-4524-ace6-3dd2e26af4b1 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:53.620241 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8e0ccdf1-6132-4524-ace6-3dd2e26af4b1 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:53.620999 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8e0ccdf1-6132-4524-ace6-3dd2e26af4b1 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:53.621423 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8e0ccdf1-6132-4524-ace6-3dd2e26af4b1 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:53.698209 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-7cd00532-c6c5-4ef6-aa52-2455ff16a9b8 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:53.698739 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-7cd00532-c6c5-4ef6-aa52-2455ff16a9b8 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: cc0c06a0-156a-4cee-8ff7-92ab582bc4a1] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:53.705531 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7cd00532-c6c5-4ef6-aa52-2455ff16a9b8 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:53.706356 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7cd00532-c6c5-4ef6-aa52-2455ff16a9b8 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:53.707178 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7cd00532-c6c5-4ef6-aa52-2455ff16a9b8 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:53.707617 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7cd00532-c6c5-4ef6-aa52-2455ff16a9b8 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:53.753318 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-8e0ccdf1-6132-4524-ace6-3dd2e26af4b1 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a98edf8e5a4a22b3ae7d041b582b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76df23454a3c4a9bb4f61b044ed5a426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:53.761543 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-8e0ccdf1-6132-4524-ace6-3dd2e26af4b1 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] 10.222.0.20 "GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f" status: 200 len: 1570 microversion: 2.1 time: 0.153350 Jul 30 05:03:53.762753 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 404/848] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:03:53 2022] GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:03:53.776797 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-1fe144d4-0dc0-4e55-aad5-0a2d4814e46a tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:53.777417 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-1fe144d4-0dc0-4e55-aad5-0a2d4814e46a tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: 40ede213-15fc-4a6c-bec6-eef18aae6b87] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:53.783918 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1fe144d4-0dc0-4e55-aad5-0a2d4814e46a tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:53.784409 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1fe144d4-0dc0-4e55-aad5-0a2d4814e46a tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:53.785319 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1fe144d4-0dc0-4e55-aad5-0a2d4814e46a tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:53.785764 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1fe144d4-0dc0-4e55-aad5-0a2d4814e46a tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:53.845341 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-7cd00532-c6c5-4ef6-aa52-2455ff16a9b8 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:53.854512 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-7cd00532-c6c5-4ef6-aa52-2455ff16a9b8 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0c06a0-156a-4cee-8ff7-92ab582bc4a1" status: 200 len: 1523 microversion: 2.1 time: 0.160635 Jul 30 05:03:53.865171 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 445/849] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:03:53 2022] GET /compute/v2.1/servers/cc0c06a0-156a-4cee-8ff7-92ab582bc4a1 => generated 1523 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 05:03:53.932235 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-1fe144d4-0dc0-4e55-aad5-0a2d4814e46a tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8abb58f9c274e568d2d0fe3d4df11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01500cb03c74d1082090cd1c1836169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:53.939997 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-1fe144d4-0dc0-4e55-aad5-0a2d4814e46a tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/40ede213-15fc-4a6c-bec6-eef18aae6b87" status: 200 len: 1367 microversion: 2.1 time: 0.166479 Jul 30 05:03:53.940608 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 405/850] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:03:53 2022] GET /compute/v2.1/servers/40ede213-15fc-4a6c-bec6-eef18aae6b87 => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 05:03:54.191149 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-4c53857e-03f4-4b61-bb89-9e55231d3841 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:54.191681 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-4c53857e-03f4-4b61-bb89-9e55231d3841 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] [instance: 0faad1c9-0b0d-44af-92cb-dd0acd61c755] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:54.197887 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4c53857e-03f4-4b61-bb89-9e55231d3841 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:54.198340 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4c53857e-03f4-4b61-bb89-9e55231d3841 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:54.199132 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4c53857e-03f4-4b61-bb89-9e55231d3841 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:54.199569 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4c53857e-03f4-4b61-bb89-9e55231d3841 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:54.261614 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell0:SELECT=4 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:03:54.316597 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell0:SELECT=18 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:03:54.332710 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-4c53857e-03f4-4b61-bb89-9e55231d3841 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42d3708ddfcc491cb366054dcd5f8881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abbb209e2c194596bb3e8b9a6880646e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:54.340021 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-4c53857e-03f4-4b61-bb89-9e55231d3841 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] 10.222.0.20 "GET /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755" status: 200 len: 1357 microversion: 2.1 time: 0.153395 Jul 30 05:03:54.340588 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 446/851] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:03:54 2022] GET /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755 => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:03:54.784031 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-caff6c2e-1478-4d97-a4ec-6344d2d75ecf tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:54.784576 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-caff6c2e-1478-4d97-a4ec-6344d2d75ecf tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] [instance: 99b497c8-e641-428a-94b6-86c21af5844f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:54.786589 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell0:SELECT=6 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:03:54.792486 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-caff6c2e-1478-4d97-a4ec-6344d2d75ecf tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:54.792935 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-caff6c2e-1478-4d97-a4ec-6344d2d75ecf tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:54.793705 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-caff6c2e-1478-4d97-a4ec-6344d2d75ecf tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:54.794138 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-caff6c2e-1478-4d97-a4ec-6344d2d75ecf tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:54.876633 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-f4b1080f-1f6d-4d53-8745-ee832d219df9 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:54.877364 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-f4b1080f-1f6d-4d53-8745-ee832d219df9 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: cc0c06a0-156a-4cee-8ff7-92ab582bc4a1] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:54.884250 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f4b1080f-1f6d-4d53-8745-ee832d219df9 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:54.884687 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f4b1080f-1f6d-4d53-8745-ee832d219df9 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:54.885451 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f4b1080f-1f6d-4d53-8745-ee832d219df9 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:54.885886 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f4b1080f-1f6d-4d53-8745-ee832d219df9 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:55.036987 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-f4b1080f-1f6d-4d53-8745-ee832d219df9 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:55.045020 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-f4b1080f-1f6d-4d53-8745-ee832d219df9 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0c06a0-156a-4cee-8ff7-92ab582bc4a1" status: 200 len: 1523 microversion: 2.1 time: 0.172125 Jul 30 05:03:55.046308 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 447/852] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:03:54 2022] GET /compute/v2.1/servers/cc0c06a0-156a-4cee-8ff7-92ab582bc4a1 => generated 1523 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 05:03:55.051870 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-addb22d3-a3ba-40de-8efd-c6e729d677fe tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:55.052762 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-addb22d3-a3ba-40de-8efd-c6e729d677fe tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: 40ede213-15fc-4a6c-bec6-eef18aae6b87] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:55.059121 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-addb22d3-a3ba-40de-8efd-c6e729d677fe tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:55.059898 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-addb22d3-a3ba-40de-8efd-c6e729d677fe tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:55.060873 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-addb22d3-a3ba-40de-8efd-c6e729d677fe tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:55.061527 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-addb22d3-a3ba-40de-8efd-c6e729d677fe tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:55.129740 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-caff6c2e-1478-4d97-a4ec-6344d2d75ecf tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a98edf8e5a4a22b3ae7d041b582b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76df23454a3c4a9bb4f61b044ed5a426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:55.138875 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-caff6c2e-1478-4d97-a4ec-6344d2d75ecf tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] 10.222.0.20 "GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f" status: 200 len: 1570 microversion: 2.1 time: 0.359199 Jul 30 05:03:55.140430 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 406/853] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:03:54 2022] GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f => generated 1570 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:03:55.263088 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-addb22d3-a3ba-40de-8efd-c6e729d677fe tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8abb58f9c274e568d2d0fe3d4df11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01500cb03c74d1082090cd1c1836169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:55.271570 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-addb22d3-a3ba-40de-8efd-c6e729d677fe tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/40ede213-15fc-4a6c-bec6-eef18aae6b87" status: 200 len: 1367 microversion: 2.1 time: 0.223849 Jul 30 05:03:55.272145 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 448/854] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:03:55 2022] GET /compute/v2.1/servers/40ede213-15fc-4a6c-bec6-eef18aae6b87 => generated 1367 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:03:55.360761 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-5ee6d363-e05c-4d50-9849-65b55218f51e tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:55.361409 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-5ee6d363-e05c-4d50-9849-65b55218f51e tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] [instance: 0faad1c9-0b0d-44af-92cb-dd0acd61c755] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:55.367498 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5ee6d363-e05c-4d50-9849-65b55218f51e tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:55.367979 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5ee6d363-e05c-4d50-9849-65b55218f51e tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:55.368741 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5ee6d363-e05c-4d50-9849-65b55218f51e tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:55.369185 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5ee6d363-e05c-4d50-9849-65b55218f51e tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:55.501241 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-06b2aac8-3f33-4f03-abc0-f148ec030f6c req-389f48d0-ab86-4767-b4a8-9ffbbaec398d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0faad1c9-0b0d-44af-92cb-dd0acd61c755", "name": "network-vif-plugged", "status": "completed", "tag": "abedbf31-d88b-46bc-a1ef-33a68dcc3b21"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:03:55.512304 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-06b2aac8-3f33-4f03-abc0-f148ec030f6c req-389f48d0-ab86-4767-b4a8-9ffbbaec398d service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:55.512746 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-06b2aac8-3f33-4f03-abc0-f148ec030f6c req-389f48d0-ab86-4767-b4a8-9ffbbaec398d service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:55.525362 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-06b2aac8-3f33-4f03-abc0-f148ec030f6c req-389f48d0-ab86-4767-b4a8-9ffbbaec398d service nova] Creating event network-vif-plugged:abedbf31-d88b-46bc-a1ef-33a68dcc3b21 for instance 0faad1c9-0b0d-44af-92cb-dd0acd61c755 on hv-cinder-85127 Jul 30 05:03:55.529862 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-06b2aac8-3f33-4f03-abc0-f148ec030f6c req-389f48d0-ab86-4767-b4a8-9ffbbaec398d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032243 Jul 30 05:03:55.531066 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 449/855] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Jul 30 05:03:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 05:03:55.719507 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-5ee6d363-e05c-4d50-9849-65b55218f51e tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42d3708ddfcc491cb366054dcd5f8881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abbb209e2c194596bb3e8b9a6880646e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:55.726895 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-5ee6d363-e05c-4d50-9849-65b55218f51e tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] 10.222.0.20 "GET /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755" status: 200 len: 1357 microversion: 2.1 time: 0.370007 Jul 30 05:03:55.727457 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 407/856] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:03:55 2022] GET /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755 => generated 1357 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:03:56.073254 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-c2e3c36e-14ca-403d-bdab-19a4a133cc37 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:56.074701 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-c2e3c36e-14ca-403d-bdab-19a4a133cc37 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: cc0c06a0-156a-4cee-8ff7-92ab582bc4a1] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:56.083000 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c2e3c36e-14ca-403d-bdab-19a4a133cc37 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:56.084326 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c2e3c36e-14ca-403d-bdab-19a4a133cc37 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:56.085396 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c2e3c36e-14ca-403d-bdab-19a4a133cc37 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:56.095600 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c2e3c36e-14ca-403d-bdab-19a4a133cc37 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:56.148871 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-301a791f-bd08-4598-9022-7a9a021ff36d req-bb0d5591-a580-4b38-9913-922165a25cd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc0c06a0-156a-4cee-8ff7-92ab582bc4a1", "name": "network-vif-deleted", "tag": "5f770f5f-036f-49c8-aec8-570d5b12103d"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:03:56.159299 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-301a791f-bd08-4598-9022-7a9a021ff36d req-bb0d5591-a580-4b38-9913-922165a25cd7 service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:56.159872 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-301a791f-bd08-4598-9022-7a9a021ff36d req-bb0d5591-a580-4b38-9913-922165a25cd7 service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:56.162332 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-c2e3c36e-14ca-403d-bdab-19a4a133cc37 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:56.164052 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell1:SELECT=100 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:03:56.170210 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-c2e3c36e-14ca-403d-bdab-19a4a133cc37 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0c06a0-156a-4cee-8ff7-92ab582bc4a1" status: 200 len: 1481 microversion: 2.1 time: 0.102080 Jul 30 05:03:56.171087 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 450/857] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:03:56 2022] GET /compute/v2.1/servers/cc0c06a0-156a-4cee-8ff7-92ab582bc4a1 => generated 1481 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:03:56.176560 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-1ad72f07-97a8-481c-88ca-19919d929e94 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:56.177231 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-1ad72f07-97a8-481c-88ca-19919d929e94 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] [instance: 99b497c8-e641-428a-94b6-86c21af5844f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:56.183073 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1ad72f07-97a8-481c-88ca-19919d929e94 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:56.183521 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1ad72f07-97a8-481c-88ca-19919d929e94 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:56.184281 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1ad72f07-97a8-481c-88ca-19919d929e94 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:56.184710 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1ad72f07-97a8-481c-88ca-19919d929e94 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:56.187237 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-301a791f-bd08-4598-9022-7a9a021ff36d req-bb0d5591-a580-4b38-9913-922165a25cd7 service nova] Creating event network-vif-deleted:5f770f5f-036f-49c8-aec8-570d5b12103d for instance cc0c06a0-156a-4cee-8ff7-92ab582bc4a1 on hv-cinder-85127 Jul 30 05:03:56.193075 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-301a791f-bd08-4598-9022-7a9a021ff36d req-bb0d5591-a580-4b38-9913-922165a25cd7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048079 Jul 30 05:03:56.193768 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 408/858] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Jul 30 05:03:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 05:03:56.293560 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-01d06827-1e02-4f13-934f-261cc779310b tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:56.294254 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-01d06827-1e02-4f13-934f-261cc779310b tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: 40ede213-15fc-4a6c-bec6-eef18aae6b87] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:56.301451 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-01d06827-1e02-4f13-934f-261cc779310b tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:56.301896 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-01d06827-1e02-4f13-934f-261cc779310b tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:56.302698 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-01d06827-1e02-4f13-934f-261cc779310b tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:56.303133 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-01d06827-1e02-4f13-934f-261cc779310b tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:56.317285 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-1ad72f07-97a8-481c-88ca-19919d929e94 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a98edf8e5a4a22b3ae7d041b582b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76df23454a3c4a9bb4f61b044ed5a426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:56.324893 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-1ad72f07-97a8-481c-88ca-19919d929e94 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] 10.222.0.20 "GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f" status: 200 len: 1570 microversion: 2.1 time: 0.152539 Jul 30 05:03:56.326145 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 451/859] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:03:56 2022] GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:03:56.565941 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-01d06827-1e02-4f13-934f-261cc779310b tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8abb58f9c274e568d2d0fe3d4df11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01500cb03c74d1082090cd1c1836169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:56.573697 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-01d06827-1e02-4f13-934f-261cc779310b tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/40ede213-15fc-4a6c-bec6-eef18aae6b87" status: 200 len: 1367 microversion: 2.1 time: 0.284203 Jul 30 05:03:56.574275 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 409/860] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:03:56 2022] GET /compute/v2.1/servers/40ede213-15fc-4a6c-bec6-eef18aae6b87 => generated 1367 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 05:03:56.749127 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-478f391c-abf7-4aa7-9508-dac75b8c1886 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:56.749747 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-478f391c-abf7-4aa7-9508-dac75b8c1886 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] [instance: 0faad1c9-0b0d-44af-92cb-dd0acd61c755] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:56.756499 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-478f391c-abf7-4aa7-9508-dac75b8c1886 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:56.756947 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-478f391c-abf7-4aa7-9508-dac75b8c1886 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:56.757706 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-478f391c-abf7-4aa7-9508-dac75b8c1886 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:56.758139 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-478f391c-abf7-4aa7-9508-dac75b8c1886 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:56.894262 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-478f391c-abf7-4aa7-9508-dac75b8c1886 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42d3708ddfcc491cb366054dcd5f8881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abbb209e2c194596bb3e8b9a6880646e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:56.901648 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-478f391c-abf7-4aa7-9508-dac75b8c1886 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] 10.222.0.20 "GET /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755" status: 200 len: 1357 microversion: 2.1 time: 0.157526 Jul 30 05:03:56.902213 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 452/861] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:03:56 2022] GET /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755 => generated 1357 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:03:57.194721 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-683525e0-d198-408b-b7f3-ba19d9bc73f7 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:57.195351 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-683525e0-d198-408b-b7f3-ba19d9bc73f7 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: cc0c06a0-156a-4cee-8ff7-92ab582bc4a1] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:57.201820 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-683525e0-d198-408b-b7f3-ba19d9bc73f7 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:57.202283 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-683525e0-d198-408b-b7f3-ba19d9bc73f7 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:57.203085 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-683525e0-d198-408b-b7f3-ba19d9bc73f7 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:57.203532 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-683525e0-d198-408b-b7f3-ba19d9bc73f7 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:57.234976 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-683525e0-d198-408b-b7f3-ba19d9bc73f7 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:57.235434 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-683525e0-d198-408b-b7f3-ba19d9bc73f7 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:57.235888 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.objects.instance [None req-683525e0-d198-408b-b7f3-ba19d9bc73f7 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lazy-loading 'fault' on Instance uuid cc0c06a0-156a-4cee-8ff7-92ab582bc4a1 {{(pid=117885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 05:03:57.275783 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-683525e0-d198-408b-b7f3-ba19d9bc73f7 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:57.283576 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-683525e0-d198-408b-b7f3-ba19d9bc73f7 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0c06a0-156a-4cee-8ff7-92ab582bc4a1" status: 200 len: 1312 microversion: 2.1 time: 0.092221 Jul 30 05:03:57.284143 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 410/862] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:03:57 2022] GET /compute/v2.1/servers/cc0c06a0-156a-4cee-8ff7-92ab582bc4a1 => generated 1312 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:03:57.348026 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-09867ee4-0706-41bf-82a4-05cace6b8ca4 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:57.348637 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-09867ee4-0706-41bf-82a4-05cace6b8ca4 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] [instance: 99b497c8-e641-428a-94b6-86c21af5844f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:57.355174 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-09867ee4-0706-41bf-82a4-05cace6b8ca4 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:57.355617 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-09867ee4-0706-41bf-82a4-05cace6b8ca4 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:57.356369 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-09867ee4-0706-41bf-82a4-05cace6b8ca4 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:57.356805 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-09867ee4-0706-41bf-82a4-05cace6b8ca4 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:57.490756 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-09867ee4-0706-41bf-82a4-05cace6b8ca4 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a98edf8e5a4a22b3ae7d041b582b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76df23454a3c4a9bb4f61b044ed5a426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:57.498190 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-09867ee4-0706-41bf-82a4-05cace6b8ca4 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] 10.222.0.20 "GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f" status: 200 len: 1557 microversion: 2.1 time: 0.154745 Jul 30 05:03:57.498779 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 453/863] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:03:57 2022] GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f => generated 1557 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:03:57.597370 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-e76bce68-4050-4d1c-a4f4-a5cf8602203b tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:57.598141 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-e76bce68-4050-4d1c-a4f4-a5cf8602203b tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: 40ede213-15fc-4a6c-bec6-eef18aae6b87] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:57.604634 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e76bce68-4050-4d1c-a4f4-a5cf8602203b tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:57.605229 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e76bce68-4050-4d1c-a4f4-a5cf8602203b tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:57.606150 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e76bce68-4050-4d1c-a4f4-a5cf8602203b tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:57.606884 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e76bce68-4050-4d1c-a4f4-a5cf8602203b tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:57.635930 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-9a404cee-e05c-41ab-acdc-6b8acb242f34 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:57.636554 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-9a404cee-e05c-41ab-acdc-6b8acb242f34 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:57.643595 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9a404cee-e05c-41ab-acdc-6b8acb242f34 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:57.644467 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9a404cee-e05c-41ab-acdc-6b8acb242f34 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:57.645249 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9a404cee-e05c-41ab-acdc-6b8acb242f34 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:57.645748 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9a404cee-e05c-41ab-acdc-6b8acb242f34 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:57.671846 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-9a404cee-e05c-41ab-acdc-6b8acb242f34 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b/ips" status: 200 len: 151 microversion: 2.20 time: 0.171982 Jul 30 05:03:57.672689 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 411/864] 10.222.0.20 () {60 vars in 1289 bytes} [Sat Jul 30 05:03:57 2022] GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b/ips => generated 151 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 30 05:03:57.757062 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-e76bce68-4050-4d1c-a4f4-a5cf8602203b tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8abb58f9c274e568d2d0fe3d4df11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01500cb03c74d1082090cd1c1836169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:57.765945 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-e76bce68-4050-4d1c-a4f4-a5cf8602203b tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/40ede213-15fc-4a6c-bec6-eef18aae6b87" status: 200 len: 1367 microversion: 2.1 time: 0.173750 Jul 30 05:03:57.766777 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 454/865] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:03:57 2022] GET /compute/v2.1/servers/40ede213-15fc-4a6c-bec6-eef18aae6b87 => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 05:03:57.922869 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-4d5568f0-94ff-4fcd-89c8-680839b15862 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:57.923700 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-4d5568f0-94ff-4fcd-89c8-680839b15862 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] [instance: 0faad1c9-0b0d-44af-92cb-dd0acd61c755] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:57.930150 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4d5568f0-94ff-4fcd-89c8-680839b15862 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:57.930629 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4d5568f0-94ff-4fcd-89c8-680839b15862 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:57.931585 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4d5568f0-94ff-4fcd-89c8-680839b15862 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:57.932022 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4d5568f0-94ff-4fcd-89c8-680839b15862 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:58.073191 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-4d5568f0-94ff-4fcd-89c8-680839b15862 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42d3708ddfcc491cb366054dcd5f8881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abbb209e2c194596bb3e8b9a6880646e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:58.081251 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-4d5568f0-94ff-4fcd-89c8-680839b15862 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] 10.222.0.20 "GET /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755" status: 200 len: 1547 microversion: 2.1 time: 0.162813 Jul 30 05:03:58.081816 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 412/866] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:03:57 2022] GET /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755 => generated 1547 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:03:58.101289 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-5ca6cedf-6e26-4a48-9a62-4b2ccb02b2d4 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:58.101907 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-5ca6cedf-6e26-4a48-9a62-4b2ccb02b2d4 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] [instance: 0faad1c9-0b0d-44af-92cb-dd0acd61c755] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:58.107851 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5ca6cedf-6e26-4a48-9a62-4b2ccb02b2d4 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:58.108300 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5ca6cedf-6e26-4a48-9a62-4b2ccb02b2d4 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:58.109059 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5ca6cedf-6e26-4a48-9a62-4b2ccb02b2d4 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:58.109496 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5ca6cedf-6e26-4a48-9a62-4b2ccb02b2d4 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:58.127839 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:03:58.244314 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-5ca6cedf-6e26-4a48-9a62-4b2ccb02b2d4 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42d3708ddfcc491cb366054dcd5f8881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abbb209e2c194596bb3e8b9a6880646e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:58.252572 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-5ca6cedf-6e26-4a48-9a62-4b2ccb02b2d4 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] 10.222.0.20 "GET /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755" status: 200 len: 1547 microversion: 2.1 time: 0.154377 Jul 30 05:03:58.253252 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 455/867] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:03:58 2022] GET /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755 => generated 1547 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 05:03:58.273159 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-37fcc3c9-d72f-4f6a-af8b-a809bf3638d0 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:58.277909 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-37fcc3c9-d72f-4f6a-af8b-a809bf3638d0 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '42d3708ddfcc491cb366054dcd5f8881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abbb209e2c194596bb3e8b9a6880646e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:58.278708 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-37fcc3c9-d72f-4f6a-af8b-a809bf3638d0 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Searching by: {'deleted': False, 'project_id': 'abbb209e2c194596bb3e8b9a6880646e'} {{(pid=117885) get_all /opt/stack/nova/nova/compute/api.py:2964}} Jul 30 05:03:58.286028 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-37fcc3c9-d72f-4f6a-af8b-a809bf3638d0 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:58.286517 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-37fcc3c9-d72f-4f6a-af8b-a809bf3638d0 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:58.287418 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-37fcc3c9-d72f-4f6a-af8b-a809bf3638d0 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:58.287843 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-37fcc3c9-d72f-4f6a-af8b-a809bf3638d0 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:58.305430 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-6d8e1d44-68e4-4174-ba8d-6dd92311b6f4 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:58.306147 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-6d8e1d44-68e4-4174-ba8d-6dd92311b6f4 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: cc0c06a0-156a-4cee-8ff7-92ab582bc4a1] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:58.312273 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6d8e1d44-68e4-4174-ba8d-6dd92311b6f4 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:58.312802 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6d8e1d44-68e4-4174-ba8d-6dd92311b6f4 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:58.313643 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6d8e1d44-68e4-4174-ba8d-6dd92311b6f4 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:58.314776 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6d8e1d44-68e4-4174-ba8d-6dd92311b6f4 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:58.346024 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6d8e1d44-68e4-4174-ba8d-6dd92311b6f4 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:58.346406 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6d8e1d44-68e4-4174-ba8d-6dd92311b6f4 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:58.346925 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.objects.instance [None req-6d8e1d44-68e4-4174-ba8d-6dd92311b6f4 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lazy-loading 'fault' on Instance uuid cc0c06a0-156a-4cee-8ff7-92ab582bc4a1 {{(pid=117886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 05:03:58.382224 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.multi_cell_list [None req-37fcc3c9-d72f-4f6a-af8b-a809bf3638d0 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117885) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 30 05:03:58.390184 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-6d8e1d44-68e4-4174-ba8d-6dd92311b6f4 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25db6f7402ae4a14a04fab0a9915ab77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decb0bd64582440590890900e594b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:58.397736 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-6d8e1d44-68e4-4174-ba8d-6dd92311b6f4 tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0c06a0-156a-4cee-8ff7-92ab582bc4a1" status: 200 len: 1312 microversion: 2.1 time: 0.096097 Jul 30 05:03:58.398552 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 456/868] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:03:58 2022] GET /compute/v2.1/servers/cc0c06a0-156a-4cee-8ff7-92ab582bc4a1 => generated 1312 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 05:03:58.474328 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-37fcc3c9-d72f-4f6a-af8b-a809bf3638d0 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.205058 Jul 30 05:03:58.474936 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 413/869] 10.222.0.20 () {58 vars in 1125 bytes} [Sat Jul 30 05:03:58 2022] GET /compute/v2.1/servers => generated 342 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 05:03:58.486510 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-320bdb18-3b2f-4250-af2e-4503ee33a397 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:58.487136 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-320bdb18-3b2f-4250-af2e-4503ee33a397 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] [instance: 0faad1c9-0b0d-44af-92cb-dd0acd61c755] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:58.493416 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-320bdb18-3b2f-4250-af2e-4503ee33a397 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:58.493868 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-320bdb18-3b2f-4250-af2e-4503ee33a397 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:58.494660 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-320bdb18-3b2f-4250-af2e-4503ee33a397 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:58.495101 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-320bdb18-3b2f-4250-af2e-4503ee33a397 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:58.626082 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-320bdb18-3b2f-4250-af2e-4503ee33a397 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42d3708ddfcc491cb366054dcd5f8881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abbb209e2c194596bb3e8b9a6880646e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:58.633948 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-320bdb18-3b2f-4250-af2e-4503ee33a397 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] 10.222.0.20 "GET /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755" status: 200 len: 1547 microversion: 2.1 time: 0.151841 Jul 30 05:03:58.634705 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 457/870] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:03:58 2022] GET /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755 => generated 1547 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:03:58.788895 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-4c0d4e33-6666-41d7-9c52-39f002ca7ed6 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:58.789512 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-4c0d4e33-6666-41d7-9c52-39f002ca7ed6 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: 40ede213-15fc-4a6c-bec6-eef18aae6b87] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:58.796299 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4c0d4e33-6666-41d7-9c52-39f002ca7ed6 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:58.796995 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4c0d4e33-6666-41d7-9c52-39f002ca7ed6 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:58.797829 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4c0d4e33-6666-41d7-9c52-39f002ca7ed6 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:58.798376 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4c0d4e33-6666-41d7-9c52-39f002ca7ed6 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:58.938978 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-4c0d4e33-6666-41d7-9c52-39f002ca7ed6 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8abb58f9c274e568d2d0fe3d4df11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01500cb03c74d1082090cd1c1836169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:58.947241 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-4c0d4e33-6666-41d7-9c52-39f002ca7ed6 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/40ede213-15fc-4a6c-bec6-eef18aae6b87" status: 200 len: 1367 microversion: 2.1 time: 0.162249 Jul 30 05:03:58.947871 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 414/871] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:03:58 2022] GET /compute/v2.1/servers/40ede213-15fc-4a6c-bec6-eef18aae6b87 => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 05:03:59.418714 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-722af56b-dabe-453c-b168-f57d93d11bde tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:59.419344 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-722af56b-dabe-453c-b168-f57d93d11bde tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] [instance: cc0c06a0-156a-4cee-8ff7-92ab582bc4a1] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:59.426782 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-722af56b-dabe-453c-b168-f57d93d11bde tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:59.427230 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-722af56b-dabe-453c-b168-f57d93d11bde tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:59.427985 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-722af56b-dabe-453c-b168-f57d93d11bde tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:59.428418 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-722af56b-dabe-453c-b168-f57d93d11bde tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:59.442417 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.wsgi [None req-722af56b-dabe-453c-b168-f57d93d11bde tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] HTTP exception thrown: Instance cc0c06a0-156a-4cee-8ff7-92ab582bc4a1 could not be found. Jul 30 05:03:59.444039 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-722af56b-dabe-453c-b168-f57d93d11bde tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Request method failure captured: Jul 30 05:03:59.444039 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: request: GET /compute/v2.1/servers/cc0c06a0-156a-4cee-8ff7-92ab582bc4a1 HTTP/1.1 Jul 30 05:03:59.444039 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Accept: application/json Jul 30 05:03:59.444039 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Accept-Encoding: identity Jul 30 05:03:59.444039 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Connection: close Jul 30 05:03:59.444039 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Content-Length: 0 Jul 30 05:03:59.444039 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Content-Type: application/json Jul 30 05:03:59.444039 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Host: 10.222.0.20 Jul 30 05:03:59.444039 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Openstack-System-Scope: None Jul 30 05:03:59.444039 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: User-Agent: python-urllib3/1.26.10 Jul 30 05:03:59.444039 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Auth-Token: gAAAAABi5Lpu5KZ-sBOjkiuZTtNR2YWcqU_r-_-3UQQ04xAT-w7gK_BuaWmEOr5Ju1pwtkZZzl_OTo-ZEKY-uHmyReS4PYVQ4M2aEskgI5yNySqgQDIjC3jupbHgF4azyUEFhR8JjMfCOfjvUulaZeOLaDw7yo-4-VTWVyQqf3A9DFmnALqdkU8 Jul 30 05:03:59.444039 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Domain-Id: None Jul 30 05:03:59.444039 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Domain-Name: None Jul 30 05:03:59.444039 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Identity-Status: Confirmed Jul 30 05:03:59.444039 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Is-Admin-Project: True Jul 30 05:03:59.444039 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Project-Domain-Id: default Jul 30 05:03:59.444039 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Project-Domain-Name: Default Jul 30 05:03:59.444039 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Project-Id: decb0bd64582440590890900e594b79e Jul 30 05:03:59.444039 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-243408600 Jul 30 05:03:59.444039 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Role: member,reader Jul 30 05:03:59.444039 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Roles: member,reader Jul 30 05:03:59.445567 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/decb0bd64582440590890900e594b79e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/decb0bd64582440590890900e594b79e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_decb0bd64582440590890900e594b79e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/decb0bd64582440590890900e594b79e"}]}] Jul 30 05:03:59.445567 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Tenant: tempest-ServerRescueNegativeTestJSON-243408600 Jul 30 05:03:59.445567 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Tenant-Id: decb0bd64582440590890900e594b79e Jul 30 05:03:59.445567 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-243408600 Jul 30 05:03:59.445567 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User: tempest-ServerRescueNegativeTestJSON-243408600-project Jul 30 05:03:59.445567 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User-Domain-Id: default Jul 30 05:03:59.445567 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User-Domain-Name: Default Jul 30 05:03:59.445567 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User-Id: 25db6f7402ae4a14a04fab0a9915ab77 Jul 30 05:03:59.445567 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User-Name: tempest-ServerRescueNegativeTestJSON-243408600-project Jul 30 05:03:59.445567 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: method: > Jul 30 05:03:59.445567 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: exception: Instance cc0c06a0-156a-4cee-8ff7-92ab582bc4a1 could not be found. Jul 30 05:03:59.445567 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: action_args: {'id': 'cc0c06a0-156a-4cee-8ff7-92ab582bc4a1'} Jul 30 05:03:59.446626 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 05:03:59.446626 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:03:59.446626 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 05:03:59.446626 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 05:03:59.446626 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 05:03:59.446626 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 05:03:59.446626 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 05:03:59.446626 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 05:03:59.446626 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 05:03:59.446626 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 05:03:59.446626 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc0c06a0-156a-4cee-8ff7-92ab582bc4a1 could not be found. Jul 30 05:03:59.446626 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 05:03:59.446626 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 05:03:59.446626 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 05:03:59.446626 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:03:59.446626 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 05:03:59.446626 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 05:03:59.446626 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 05:03:59.446626 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 05:03:59.446626 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 05:03:59.448083 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 05:03:59.448083 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 05:03:59.448083 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 05:03:59.448083 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 05:03:59.448083 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 05:03:59.448083 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 05:03:59.448083 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 05:03:59.448083 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc0c06a0-156a-4cee-8ff7-92ab582bc4a1 could not be found. Jul 30 05:03:59.448083 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 05:03:59.448083 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 05:03:59.448083 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 05:03:59.448083 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:03:59.448083 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 05:03:59.448083 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 05:03:59.448083 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 05:03:59.448083 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 05:03:59.448083 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc0c06a0-156a-4cee-8ff7-92ab582bc4a1 could not be found. Jul 30 05:03:59.448083 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 05:03:59.449570 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-722af56b-dabe-453c-b168-f57d93d11bde tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] Returning 404 to user: Instance cc0c06a0-156a-4cee-8ff7-92ab582bc4a1 could not be found. {{(pid=117886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 05:03:59.449570 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-722af56b-dabe-453c-b168-f57d93d11bde tempest-ServerRescueNegativeTestJSON-243408600 tempest-ServerRescueNegativeTestJSON-243408600-project] 10.222.0.20 "GET /compute/v2.1/servers/cc0c06a0-156a-4cee-8ff7-92ab582bc4a1" status: 404 len: 111 microversion: 2.1 time: 0.030599 Jul 30 05:03:59.449570 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 458/872] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:03:59 2022] GET /compute/v2.1/servers/cc0c06a0-156a-4cee-8ff7-92ab582bc4a1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 05:03:59.532096 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-69951976-de6e-47d3-a9a8-788aa0f01ab3 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:03:59.535006 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-69951976-de6e-47d3-a9a8-788aa0f01ab3 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:59.539959 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-69951976-de6e-47d3-a9a8-788aa0f01ab3 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:59.540495 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-69951976-de6e-47d3-a9a8-788aa0f01ab3 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:59.541331 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-69951976-de6e-47d3-a9a8-788aa0f01ab3 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:59.541792 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-69951976-de6e-47d3-a9a8-788aa0f01ab3 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:59.566103 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.objects.instance [None req-69951976-de6e-47d3-a9a8-788aa0f01ab3 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lazy-loading 'flavor' on Instance uuid b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b {{(pid=117885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 05:03:59.742776 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-69951976-de6e-47d3-a9a8-788aa0f01ab3 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "POST /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b/action" status: 202 len: 0 microversion: 2.20 time: 0.214309 Jul 30 05:03:59.743372 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 415/873] 10.222.0.20 () {62 vars in 1319 bytes} [Sat Jul 30 05:03:59 2022] POST /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b/action => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 30 05:03:59.751432 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-79bbee51-5d2d-44b8-9930-fbd2cff2b3b3 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:59.752303 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-79bbee51-5d2d-44b8-9930-fbd2cff2b3b3 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:59.758397 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-79bbee51-5d2d-44b8-9930-fbd2cff2b3b3 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:59.759082 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-79bbee51-5d2d-44b8-9930-fbd2cff2b3b3 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:59.759665 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-79bbee51-5d2d-44b8-9930-fbd2cff2b3b3 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:59.760105 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-79bbee51-5d2d-44b8-9930-fbd2cff2b3b3 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:59.894782 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-79bbee51-5d2d-44b8-9930-fbd2cff2b3b3 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:59.902808 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-79bbee51-5d2d-44b8-9930-fbd2cff2b3b3 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:59.904308 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-79bbee51-5d2d-44b8-9930-fbd2cff2b3b3 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:03:59.905460 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-79bbee51-5d2d-44b8-9930-fbd2cff2b3b3 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b" status: 200 len: 1724 microversion: 2.20 time: 0.157914 Jul 30 05:03:59.906015 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 459/874] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:03:59 2022] GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 05:03:59.969821 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-a70c02fe-e8c8-4fb6-ba02-c119817f3890 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:03:59.971070 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-a70c02fe-e8c8-4fb6-ba02-c119817f3890 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: 40ede213-15fc-4a6c-bec6-eef18aae6b87] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:03:59.977922 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a70c02fe-e8c8-4fb6-ba02-c119817f3890 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:59.978601 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a70c02fe-e8c8-4fb6-ba02-c119817f3890 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:03:59.979398 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a70c02fe-e8c8-4fb6-ba02-c119817f3890 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:03:59.979839 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a70c02fe-e8c8-4fb6-ba02-c119817f3890 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:00.202635 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-9ae08f05-2138-4103-a146-0b0e269c6d11 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bf46e11b-0d9e-403c-9a47-aae4c5b55cbc"}} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:04:00.205746 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-9ae08f05-2138-4103-a146-0b0e269c6d11 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] [instance: 0faad1c9-0b0d-44af-92cb-dd0acd61c755] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:04:00.211905 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9ae08f05-2138-4103-a146-0b0e269c6d11 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:00.212357 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9ae08f05-2138-4103-a146-0b0e269c6d11 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:00.213128 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9ae08f05-2138-4103-a146-0b0e269c6d11 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:00.213562 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9ae08f05-2138-4103-a146-0b0e269c6d11 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:00.230319 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-a70c02fe-e8c8-4fb6-ba02-c119817f3890 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8abb58f9c274e568d2d0fe3d4df11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01500cb03c74d1082090cd1c1836169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:00.237574 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-a70c02fe-e8c8-4fb6-ba02-c119817f3890 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/40ede213-15fc-4a6c-bec6-eef18aae6b87" status: 200 len: 1367 microversion: 2.1 time: 0.272150 Jul 30 05:04:00.250660 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 416/875] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:03:59 2022] GET /compute/v2.1/servers/40ede213-15fc-4a6c-bec6-eef18aae6b87 => generated 1367 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:04:00.458162 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-9ae08f05-2138-4103-a146-0b0e269c6d11 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] 10.222.0.20 "POST /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.259174 Jul 30 05:04:00.459172 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 460/876] 10.222.0.20 () {60 vars in 1323 bytes} [Sat Jul 30 05:04:00 2022] POST /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755/os-volume_attachments => generated 194 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 05:04:00.929014 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-474559c7-5c4e-45c9-889d-391581527df7 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:04:00.929878 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-474559c7-5c4e-45c9-889d-391581527df7 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:04:00.937045 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-474559c7-5c4e-45c9-889d-391581527df7 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:00.937680 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-474559c7-5c4e-45c9-889d-391581527df7 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:00.939594 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-474559c7-5c4e-45c9-889d-391581527df7 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:00.940216 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-474559c7-5c4e-45c9-889d-391581527df7 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:01.138923 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-474559c7-5c4e-45c9-889d-391581527df7 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:01.148088 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-474559c7-5c4e-45c9-889d-391581527df7 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:01.149518 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-474559c7-5c4e-45c9-889d-391581527df7 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:01.150715 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-474559c7-5c4e-45c9-889d-391581527df7 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b" status: 200 len: 1724 microversion: 2.20 time: 0.225635 Jul 30 05:04:01.151277 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 417/877] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:04:00 2022] GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b => generated 1724 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 05:04:01.260433 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-108487cf-48c5-4274-a453-62e064406e5e tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:04:01.261333 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-108487cf-48c5-4274-a453-62e064406e5e tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: 40ede213-15fc-4a6c-bec6-eef18aae6b87] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:04:01.269639 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-108487cf-48c5-4274-a453-62e064406e5e tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:01.270314 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-108487cf-48c5-4274-a453-62e064406e5e tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:01.271316 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-108487cf-48c5-4274-a453-62e064406e5e tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:01.271922 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-108487cf-48c5-4274-a453-62e064406e5e tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:01.428217 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-108487cf-48c5-4274-a453-62e064406e5e tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8abb58f9c274e568d2d0fe3d4df11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01500cb03c74d1082090cd1c1836169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:01.436612 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-108487cf-48c5-4274-a453-62e064406e5e tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/40ede213-15fc-4a6c-bec6-eef18aae6b87" status: 200 len: 1367 microversion: 2.1 time: 0.181016 Jul 30 05:04:01.444696 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 461/878] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:04:01 2022] GET /compute/v2.1/servers/40ede213-15fc-4a6c-bec6-eef18aae6b87 => generated 1367 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:04:02.173617 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-702583b5-6652-4081-9e6b-82ddfaf202f2 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:04:02.174310 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-702583b5-6652-4081-9e6b-82ddfaf202f2 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:04:02.181396 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-702583b5-6652-4081-9e6b-82ddfaf202f2 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:02.182039 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-702583b5-6652-4081-9e6b-82ddfaf202f2 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:02.182896 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-702583b5-6652-4081-9e6b-82ddfaf202f2 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:02.183339 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-702583b5-6652-4081-9e6b-82ddfaf202f2 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:02.340243 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-702583b5-6652-4081-9e6b-82ddfaf202f2 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:02.348551 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-702583b5-6652-4081-9e6b-82ddfaf202f2 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:02.350130 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-702583b5-6652-4081-9e6b-82ddfaf202f2 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:02.351426 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-702583b5-6652-4081-9e6b-82ddfaf202f2 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b" status: 200 len: 1724 microversion: 2.20 time: 0.182270 Jul 30 05:04:02.352093 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 418/879] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:04:02 2022] GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b => generated 1724 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 05:04:02.459959 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-234be3fd-9e5b-406a-9c9f-ddfb8c9b0e3f tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:04:02.461207 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-234be3fd-9e5b-406a-9c9f-ddfb8c9b0e3f tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: 40ede213-15fc-4a6c-bec6-eef18aae6b87] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:04:02.468333 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-234be3fd-9e5b-406a-9c9f-ddfb8c9b0e3f tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:02.468582 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-234be3fd-9e5b-406a-9c9f-ddfb8c9b0e3f tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:02.469390 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-234be3fd-9e5b-406a-9c9f-ddfb8c9b0e3f tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:02.469770 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-234be3fd-9e5b-406a-9c9f-ddfb8c9b0e3f tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:02.660310 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-234be3fd-9e5b-406a-9c9f-ddfb8c9b0e3f tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8abb58f9c274e568d2d0fe3d4df11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01500cb03c74d1082090cd1c1836169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:02.668769 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-234be3fd-9e5b-406a-9c9f-ddfb8c9b0e3f tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/40ede213-15fc-4a6c-bec6-eef18aae6b87" status: 200 len: 1367 microversion: 2.1 time: 0.212637 Jul 30 05:04:02.672448 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 462/880] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:04:02 2022] GET /compute/v2.1/servers/40ede213-15fc-4a6c-bec6-eef18aae6b87 => generated 1367 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:04:03.250667 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-b0b6dd40-863a-49f4-ae53-73f6de1bf26f req-343902be-f12b-469a-ac6b-c6a2424751ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40ede213-15fc-4a6c-bec6-eef18aae6b87", "name": "network-vif-plugged", "status": "completed", "tag": "71dbf2c2-385e-484d-a2ac-d51216c17d84"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:04:03.262126 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-b0b6dd40-863a-49f4-ae53-73f6de1bf26f req-343902be-f12b-469a-ac6b-c6a2424751ec service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:03.262857 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-b0b6dd40-863a-49f4-ae53-73f6de1bf26f req-343902be-f12b-469a-ac6b-c6a2424751ec service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:03.276738 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-b0b6dd40-863a-49f4-ae53-73f6de1bf26f req-343902be-f12b-469a-ac6b-c6a2424751ec service nova] Creating event network-vif-plugged:71dbf2c2-385e-484d-a2ac-d51216c17d84 for instance 40ede213-15fc-4a6c-bec6-eef18aae6b87 on hv-cinder-85127 Jul 30 05:04:03.281785 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-b0b6dd40-863a-49f4-ae53-73f6de1bf26f req-343902be-f12b-469a-ac6b-c6a2424751ec service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035859 Jul 30 05:04:03.283034 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 419/881] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Jul 30 05:04:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 05:04:03.374537 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-54ec2090-5612-4f7e-8038-8fd6ca17c7d5 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:04:03.375258 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-54ec2090-5612-4f7e-8038-8fd6ca17c7d5 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:04:03.381783 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-54ec2090-5612-4f7e-8038-8fd6ca17c7d5 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:03.382318 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-54ec2090-5612-4f7e-8038-8fd6ca17c7d5 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:03.383184 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-54ec2090-5612-4f7e-8038-8fd6ca17c7d5 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:03.383689 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-54ec2090-5612-4f7e-8038-8fd6ca17c7d5 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:03.561698 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-54ec2090-5612-4f7e-8038-8fd6ca17c7d5 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:03.572027 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-54ec2090-5612-4f7e-8038-8fd6ca17c7d5 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:03.574824 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-54ec2090-5612-4f7e-8038-8fd6ca17c7d5 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:03.576235 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-54ec2090-5612-4f7e-8038-8fd6ca17c7d5 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b" status: 200 len: 1724 microversion: 2.20 time: 0.205720 Jul 30 05:04:03.591232 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 463/882] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:04:03 2022] GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b => generated 1724 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 05:04:03.693576 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-3e7fb594-1852-4fdc-b11f-4294e658536b tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:04:03.694335 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-3e7fb594-1852-4fdc-b11f-4294e658536b tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: 40ede213-15fc-4a6c-bec6-eef18aae6b87] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:04:03.702333 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3e7fb594-1852-4fdc-b11f-4294e658536b tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:03.702955 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3e7fb594-1852-4fdc-b11f-4294e658536b tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:03.704062 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3e7fb594-1852-4fdc-b11f-4294e658536b tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:03.705258 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3e7fb594-1852-4fdc-b11f-4294e658536b tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:03.845430 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-3e7fb594-1852-4fdc-b11f-4294e658536b tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8abb58f9c274e568d2d0fe3d4df11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01500cb03c74d1082090cd1c1836169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:03.853585 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-3e7fb594-1852-4fdc-b11f-4294e658536b tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/40ede213-15fc-4a6c-bec6-eef18aae6b87" status: 200 len: 1367 microversion: 2.1 time: 0.164349 Jul 30 05:04:03.854157 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 420/883] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:04:03 2022] GET /compute/v2.1/servers/40ede213-15fc-4a6c-bec6-eef18aae6b87 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:04:04.397540 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-997d334e-f4a7-46ae-8953-875c3b99b9cc tempest-VolumesSnapshotsTestJSON-1857672228 tempest-VolumesSnapshotsTestJSON-1857672228-project] Action: 'create', calling method: .version_select at 0x7f2daf76cd30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-328775339"}} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:04:04.601894 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-ce6917b3-f353-4d72-b6fd-bf3722b59706 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:04:04.602551 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-ce6917b3-f353-4d72-b6fd-bf3722b59706 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:04:04.609196 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ce6917b3-f353-4d72-b6fd-bf3722b59706 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:04.609946 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ce6917b3-f353-4d72-b6fd-bf3722b59706 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:04.611228 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ce6917b3-f353-4d72-b6fd-bf3722b59706 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:04.611820 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ce6917b3-f353-4d72-b6fd-bf3722b59706 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:04.697253 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-997d334e-f4a7-46ae-8953-875c3b99b9cc tempest-VolumesSnapshotsTestJSON-1857672228 tempest-VolumesSnapshotsTestJSON-1857672228-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.419183 Jul 30 05:04:04.698223 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 464/884] 10.222.0.20 () {60 vars in 1155 bytes} [Sat Jul 30 05:04:04 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 421 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 30 05:04:04.710967 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-e016c9b4-f4fc-4761-9d16-514d83899e8f tempest-VolumesSnapshotsTestJSON-1857672228 tempest-VolumesSnapshotsTestJSON-1857672228-project] Calling method '.version_select at 0x7f2daf6ad280>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:04:04.766318 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-e016c9b4-f4fc-4761-9d16-514d83899e8f tempest-VolumesSnapshotsTestJSON-1857672228 tempest-VolumesSnapshotsTestJSON-1857672228-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/8f875f9e-19ac-467c-b7f9-2271269bdd6b" status: 200 len: 344 microversion: 2.1 time: 0.059170 Jul 30 05:04:04.766995 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 465/885] 10.222.0.20 () {58 vars in 1245 bytes} [Sat Jul 30 05:04:04 2022] GET /compute/v2.1/os-volumes/8f875f9e-19ac-467c-b7f9-2271269bdd6b => generated 344 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 05:04:04.770241 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-ce6917b3-f353-4d72-b6fd-bf3722b59706 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:04.778293 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-ce6917b3-f353-4d72-b6fd-bf3722b59706 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:04.779841 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-ce6917b3-f353-4d72-b6fd-bf3722b59706 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:04.781007 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-ce6917b3-f353-4d72-b6fd-bf3722b59706 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b" status: 200 len: 1724 microversion: 2.20 time: 0.183065 Jul 30 05:04:04.781565 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 421/886] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:04:04 2022] GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b => generated 1724 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 05:04:04.874618 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-73d752ca-0d57-429b-bd6b-f84cb9aac65b tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:04:04.875158 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-73d752ca-0d57-429b-bd6b-f84cb9aac65b tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: 40ede213-15fc-4a6c-bec6-eef18aae6b87] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:04:04.882408 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-73d752ca-0d57-429b-bd6b-f84cb9aac65b tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:04.882892 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-73d752ca-0d57-429b-bd6b-f84cb9aac65b tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:04.883696 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-73d752ca-0d57-429b-bd6b-f84cb9aac65b tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:04.884138 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-73d752ca-0d57-429b-bd6b-f84cb9aac65b tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:05.026289 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-73d752ca-0d57-429b-bd6b-f84cb9aac65b tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8abb58f9c274e568d2d0fe3d4df11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01500cb03c74d1082090cd1c1836169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:05.034618 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-73d752ca-0d57-429b-bd6b-f84cb9aac65b tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/40ede213-15fc-4a6c-bec6-eef18aae6b87" status: 200 len: 1367 microversion: 2.1 time: 0.163848 Jul 30 05:04:05.035181 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 466/887] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:04:04 2022] GET /compute/v2.1/servers/40ede213-15fc-4a6c-bec6-eef18aae6b87 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:04:05.780081 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-08ea952d-f5ef-4a85-b7f7-2c604609bbb6 tempest-VolumesSnapshotsTestJSON-1857672228 tempest-VolumesSnapshotsTestJSON-1857672228-project] Calling method '.version_select at 0x7f2daf627c10>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:04:05.805054 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-03e7fb4f-884b-4662-ae2c-82450305b32b tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:04:05.805685 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-03e7fb4f-884b-4662-ae2c-82450305b32b tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:04:05.812156 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-03e7fb4f-884b-4662-ae2c-82450305b32b tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:05.812747 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-03e7fb4f-884b-4662-ae2c-82450305b32b tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:05.813529 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-03e7fb4f-884b-4662-ae2c-82450305b32b tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:05.814705 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-03e7fb4f-884b-4662-ae2c-82450305b32b tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:05.847501 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-08ea952d-f5ef-4a85-b7f7-2c604609bbb6 tempest-VolumesSnapshotsTestJSON-1857672228 tempest-VolumesSnapshotsTestJSON-1857672228-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/8f875f9e-19ac-467c-b7f9-2271269bdd6b" status: 200 len: 345 microversion: 2.1 time: 0.070784 Jul 30 05:04:05.848292 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 422/888] 10.222.0.20 () {58 vars in 1245 bytes} [Sat Jul 30 05:04:05 2022] GET /compute/v2.1/os-volumes/8f875f9e-19ac-467c-b7f9-2271269bdd6b => generated 345 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 05:04:05.862098 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-6ad525b6-9985-40b6-9919-e0fb0bb13abb tempest-VolumesSnapshotsTestJSON-1857672228 tempest-VolumesSnapshotsTestJSON-1857672228-project] Action: 'create', calling method: .version_select at 0x7f2daf67c700>, body: {"snapshot": {"volume_id": "8f875f9e-19ac-467c-b7f9-2271269bdd6b", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-2011682294"}} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:04:05.948430 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-03e7fb4f-884b-4662-ae2c-82450305b32b tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:05.956944 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-03e7fb4f-884b-4662-ae2c-82450305b32b tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:05.958644 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-03e7fb4f-884b-4662-ae2c-82450305b32b tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:05.959970 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-03e7fb4f-884b-4662-ae2c-82450305b32b tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b" status: 200 len: 1724 microversion: 2.20 time: 0.158753 Jul 30 05:04:05.960576 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 467/889] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:04:05 2022] GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 05:04:06.018808 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-6ad525b6-9985-40b6-9919-e0fb0bb13abb tempest-VolumesSnapshotsTestJSON-1857672228 tempest-VolumesSnapshotsTestJSON-1857672228-project] 10.222.0.20 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.161210 Jul 30 05:04:06.019550 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 423/890] 10.222.0.20 () {60 vars in 1162 bytes} [Sat Jul 30 05:04:05 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 05:04:06.030372 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-ea13fd1f-ddb7-4927-97d5-fec0fd219e97 tempest-VolumesSnapshotsTestJSON-1857672228 tempest-VolumesSnapshotsTestJSON-1857672228-project] Calling method '.version_select at 0x7f2daf6ab5e0>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:04:06.055851 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-45fe3435-3276-4c04-92b5-e8afbcc3f4b0 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:04:06.056449 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-45fe3435-3276-4c04-92b5-e8afbcc3f4b0 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: 40ede213-15fc-4a6c-bec6-eef18aae6b87] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:04:06.061287 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-ea13fd1f-ddb7-4927-97d5-fec0fd219e97 tempest-VolumesSnapshotsTestJSON-1857672228 tempest-VolumesSnapshotsTestJSON-1857672228-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/af8439af-2073-461f-b06d-6292303a3da6" status: 200 len: 287 microversion: 2.1 time: 0.035029 Jul 30 05:04:06.062101 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 468/891] 10.222.0.20 () {58 vars in 1251 bytes} [Sat Jul 30 05:04:06 2022] GET /compute/v2.1/os-snapshots/af8439af-2073-461f-b06d-6292303a3da6 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 05:04:06.063619 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-45fe3435-3276-4c04-92b5-e8afbcc3f4b0 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:06.064342 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-45fe3435-3276-4c04-92b5-e8afbcc3f4b0 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:06.065266 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-45fe3435-3276-4c04-92b5-e8afbcc3f4b0 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:06.065823 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-45fe3435-3276-4c04-92b5-e8afbcc3f4b0 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:06.073368 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-0e24a535-e3f9-432e-8242-df73292bd332 tempest-VolumesSnapshotsTestJSON-1857672228 tempest-VolumesSnapshotsTestJSON-1857672228-project] Calling method '.version_select at 0x7f2daf6ab1f0>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:04:06.104514 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-0e24a535-e3f9-432e-8242-df73292bd332 tempest-VolumesSnapshotsTestJSON-1857672228 tempest-VolumesSnapshotsTestJSON-1857672228-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.034589 Jul 30 05:04:06.106466 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 469/892] 10.222.0.20 () {58 vars in 1140 bytes} [Sat Jul 30 05:04:06 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 05:04:06.118752 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-c8b0ce4f-8505-42bb-92e9-af0390790428 tempest-VolumesSnapshotsTestJSON-1857672228 tempest-VolumesSnapshotsTestJSON-1857672228-project] Calling method '.version_select at 0x7f2db40be550>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:04:06.149013 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-c8b0ce4f-8505-42bb-92e9-af0390790428 tempest-VolumesSnapshotsTestJSON-1857672228 tempest-VolumesSnapshotsTestJSON-1857672228-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/af8439af-2073-461f-b06d-6292303a3da6" status: 200 len: 287 microversion: 2.1 time: 0.034197 Jul 30 05:04:06.149576 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 470/893] 10.222.0.20 () {58 vars in 1251 bytes} [Sat Jul 30 05:04:06 2022] GET /compute/v2.1/os-snapshots/af8439af-2073-461f-b06d-6292303a3da6 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 05:04:06.199501 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-45fe3435-3276-4c04-92b5-e8afbcc3f4b0 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8abb58f9c274e568d2d0fe3d4df11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01500cb03c74d1082090cd1c1836169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:06.206929 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-45fe3435-3276-4c04-92b5-e8afbcc3f4b0 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/40ede213-15fc-4a6c-bec6-eef18aae6b87" status: 200 len: 1557 microversion: 2.1 time: 0.154834 Jul 30 05:04:06.207517 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 424/894] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:04:06 2022] GET /compute/v2.1/servers/40ede213-15fc-4a6c-bec6-eef18aae6b87 => generated 1557 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 05:04:06.227425 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-89efd64d-4f60-46ba-9657-ac6a4285a9c4 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:04:06.227925 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-89efd64d-4f60-46ba-9657-ac6a4285a9c4 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: 40ede213-15fc-4a6c-bec6-eef18aae6b87] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:04:06.234016 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-89efd64d-4f60-46ba-9657-ac6a4285a9c4 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:06.234506 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-89efd64d-4f60-46ba-9657-ac6a4285a9c4 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:06.235273 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-89efd64d-4f60-46ba-9657-ac6a4285a9c4 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:06.236346 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-89efd64d-4f60-46ba-9657-ac6a4285a9c4 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:06.311851 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-89efd64d-4f60-46ba-9657-ac6a4285a9c4 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/40ede213-15fc-4a6c-bec6-eef18aae6b87/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088211 Jul 30 05:04:06.312440 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 471/895] 10.222.0.20 () {58 vars in 1275 bytes} [Sat Jul 30 05:04:06 2022] GET /compute/v2.1/servers/40ede213-15fc-4a6c-bec6-eef18aae6b87/os-interface => generated 285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 05:04:06.984332 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-870fbca5-fb16-4bce-96f7-5482280b00ac tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:04:06.984948 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-870fbca5-fb16-4bce-96f7-5482280b00ac tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:04:06.992553 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-870fbca5-fb16-4bce-96f7-5482280b00ac tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:06.993005 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-870fbca5-fb16-4bce-96f7-5482280b00ac tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:06.993779 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-870fbca5-fb16-4bce-96f7-5482280b00ac tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:06.994221 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-870fbca5-fb16-4bce-96f7-5482280b00ac tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:07.128822 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-870fbca5-fb16-4bce-96f7-5482280b00ac tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:07.132411 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:04:07.137729 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-870fbca5-fb16-4bce-96f7-5482280b00ac tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:07.139283 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-870fbca5-fb16-4bce-96f7-5482280b00ac tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:07.140434 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-870fbca5-fb16-4bce-96f7-5482280b00ac tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b" status: 200 len: 1724 microversion: 2.20 time: 0.160004 Jul 30 05:04:07.141008 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 425/896] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:04:06 2022] GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 05:04:07.162024 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-cc2e20b8-f8c0-46fa-a516-209157ac3531 tempest-VolumesSnapshotsTestJSON-1857672228 tempest-VolumesSnapshotsTestJSON-1857672228-project] Calling method '.version_select at 0x7f2db41a2670>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:04:07.193573 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-cc2e20b8-f8c0-46fa-a516-209157ac3531 tempest-VolumesSnapshotsTestJSON-1857672228 tempest-VolumesSnapshotsTestJSON-1857672228-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/af8439af-2073-461f-b06d-6292303a3da6" status: 200 len: 287 microversion: 2.1 time: 0.036123 Jul 30 05:04:07.194152 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 472/897] 10.222.0.20 () {58 vars in 1251 bytes} [Sat Jul 30 05:04:07 2022] GET /compute/v2.1/os-snapshots/af8439af-2073-461f-b06d-6292303a3da6 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 05:04:07.582368 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-929807cf-5f28-4afe-8e4c-73ee5b108336 req-9f83c59d-f700-41cb-af0d-cbdc08e0ad81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40ede213-15fc-4a6c-bec6-eef18aae6b87", "tag": "71dbf2c2-385e-484d-a2ac-d51216c17d84"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:04:07.591779 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-929807cf-5f28-4afe-8e4c-73ee5b108336 req-9f83c59d-f700-41cb-af0d-cbdc08e0ad81 service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:07.592230 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-929807cf-5f28-4afe-8e4c-73ee5b108336 req-9f83c59d-f700-41cb-af0d-cbdc08e0ad81 service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:07.603560 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-929807cf-5f28-4afe-8e4c-73ee5b108336 req-9f83c59d-f700-41cb-af0d-cbdc08e0ad81 service nova] Creating event network-changed:71dbf2c2-385e-484d-a2ac-d51216c17d84 for instance 40ede213-15fc-4a6c-bec6-eef18aae6b87 on hv-cinder-85127 Jul 30 05:04:07.608344 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-929807cf-5f28-4afe-8e4c-73ee5b108336 req-9f83c59d-f700-41cb-af0d-cbdc08e0ad81 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091456 Jul 30 05:04:07.608941 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 426/898] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Jul 30 05:04:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 05:04:08.164181 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-453872bc-4988-45c0-a882-d08c40081e4f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:04:08.164882 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-453872bc-4988-45c0-a882-d08c40081e4f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:04:08.171455 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-453872bc-4988-45c0-a882-d08c40081e4f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:08.171897 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-453872bc-4988-45c0-a882-d08c40081e4f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:08.172660 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-453872bc-4988-45c0-a882-d08c40081e4f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:08.173610 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-453872bc-4988-45c0-a882-d08c40081e4f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:08.207281 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-5ea0c318-9844-4b57-92ef-83ab408f1247 tempest-VolumesSnapshotsTestJSON-1857672228 tempest-VolumesSnapshotsTestJSON-1857672228-project] Calling method '.version_select at 0x7f2daf67c3a0>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:04:08.248143 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-5ea0c318-9844-4b57-92ef-83ab408f1247 tempest-VolumesSnapshotsTestJSON-1857672228 tempest-VolumesSnapshotsTestJSON-1857672228-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/af8439af-2073-461f-b06d-6292303a3da6" status: 200 len: 287 microversion: 2.1 time: 0.043993 Jul 30 05:04:08.254151 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 427/899] 10.222.0.20 () {58 vars in 1251 bytes} [Sat Jul 30 05:04:08 2022] GET /compute/v2.1/os-snapshots/af8439af-2073-461f-b06d-6292303a3da6 => generated 287 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 05:04:08.314247 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-453872bc-4988-45c0-a882-d08c40081e4f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:08.322609 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-453872bc-4988-45c0-a882-d08c40081e4f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:08.324132 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-453872bc-4988-45c0-a882-d08c40081e4f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:08.325314 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-453872bc-4988-45c0-a882-d08c40081e4f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b" status: 200 len: 1724 microversion: 2.20 time: 0.165547 Jul 30 05:04:08.325888 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 473/900] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:04:08 2022] GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 05:04:09.258408 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell0:SELECT=2 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:04:09.263291 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-ceef42b9-40f1-4439-9505-b137d0c369be tempest-VolumesSnapshotsTestJSON-1857672228 tempest-VolumesSnapshotsTestJSON-1857672228-project] Calling method '.version_select at 0x7f2daf7fb3a0>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:04:09.295673 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-ceef42b9-40f1-4439-9505-b137d0c369be tempest-VolumesSnapshotsTestJSON-1857672228 tempest-VolumesSnapshotsTestJSON-1857672228-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/af8439af-2073-461f-b06d-6292303a3da6" status: 200 len: 288 microversion: 2.1 time: 0.037788 Jul 30 05:04:09.296236 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 428/901] 10.222.0.20 () {58 vars in 1251 bytes} [Sat Jul 30 05:04:09 2022] GET /compute/v2.1/os-snapshots/af8439af-2073-461f-b06d-6292303a3da6 => generated 288 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 05:04:09.307919 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-0592e73a-d365-4110-b49f-e56d558fe554 tempest-VolumesSnapshotsTestJSON-1857672228 tempest-VolumesSnapshotsTestJSON-1857672228-project] Calling method '.version_select at 0x7f2daf6fb430>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:04:09.348625 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-e0e84d5b-6cdb-469e-999a-7c1c6ed93845 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:04:09.349340 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-e0e84d5b-6cdb-469e-999a-7c1c6ed93845 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:04:09.356261 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e0e84d5b-6cdb-469e-999a-7c1c6ed93845 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:09.356695 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e0e84d5b-6cdb-469e-999a-7c1c6ed93845 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:09.357454 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e0e84d5b-6cdb-469e-999a-7c1c6ed93845 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:09.357845 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e0e84d5b-6cdb-469e-999a-7c1c6ed93845 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:09.368844 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-0592e73a-d365-4110-b49f-e56d558fe554 tempest-VolumesSnapshotsTestJSON-1857672228 tempest-VolumesSnapshotsTestJSON-1857672228-project] 10.222.0.20 "DELETE /compute/v2.1/os-snapshots/af8439af-2073-461f-b06d-6292303a3da6" status: 202 len: 0 microversion: 2.1 time: 0.064664 Jul 30 05:04:09.369540 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 474/902] 10.222.0.20 () {58 vars in 1254 bytes} [Sat Jul 30 05:04:09 2022] DELETE /compute/v2.1/os-snapshots/af8439af-2073-461f-b06d-6292303a3da6 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 05:04:09.377910 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-9ffbabb6-f64f-4e2e-acc0-4bc578b5819d tempest-VolumesSnapshotsTestJSON-1857672228 tempest-VolumesSnapshotsTestJSON-1857672228-project] Calling method '.version_select at 0x7f2daf6ade50>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:04:09.407407 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-9ffbabb6-f64f-4e2e-acc0-4bc578b5819d tempest-VolumesSnapshotsTestJSON-1857672228 tempest-VolumesSnapshotsTestJSON-1857672228-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/af8439af-2073-461f-b06d-6292303a3da6" status: 200 len: 287 microversion: 2.1 time: 0.033731 Jul 30 05:04:09.408156 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 475/903] 10.222.0.20 () {58 vars in 1251 bytes} [Sat Jul 30 05:04:09 2022] GET /compute/v2.1/os-snapshots/af8439af-2073-461f-b06d-6292303a3da6 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 05:04:09.590062 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-e0e84d5b-6cdb-469e-999a-7c1c6ed93845 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:09.598159 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-e0e84d5b-6cdb-469e-999a-7c1c6ed93845 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:09.599691 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-e0e84d5b-6cdb-469e-999a-7c1c6ed93845 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:09.600850 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-e0e84d5b-6cdb-469e-999a-7c1c6ed93845 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b" status: 200 len: 1724 microversion: 2.20 time: 0.256246 Jul 30 05:04:09.601414 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 429/904] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:04:09 2022] GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b => generated 1724 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 05:04:10.201527 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-4c81d804-3de3-419d-8e50-a3e2fd7168fc tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:04:10.202138 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-4c81d804-3de3-419d-8e50-a3e2fd7168fc tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] [instance: 0faad1c9-0b0d-44af-92cb-dd0acd61c755] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:04:10.209087 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4c81d804-3de3-419d-8e50-a3e2fd7168fc tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:10.209542 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4c81d804-3de3-419d-8e50-a3e2fd7168fc tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:10.210307 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4c81d804-3de3-419d-8e50-a3e2fd7168fc tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:10.210785 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4c81d804-3de3-419d-8e50-a3e2fd7168fc tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:10.340668 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-4c81d804-3de3-419d-8e50-a3e2fd7168fc tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42d3708ddfcc491cb366054dcd5f8881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abbb209e2c194596bb3e8b9a6880646e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:10.348598 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-4c81d804-3de3-419d-8e50-a3e2fd7168fc tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] 10.222.0.20 "GET /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755" status: 200 len: 1593 microversion: 2.1 time: 0.150849 Jul 30 05:04:10.349152 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 476/905] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:04:10 2022] GET /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755 => generated 1593 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:04:10.420025 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-ebeb153c-15b6-4e30-894c-8861d48f01b1 tempest-VolumesSnapshotsTestJSON-1857672228 tempest-VolumesSnapshotsTestJSON-1857672228-project] Calling method '.version_select at 0x7f2daf67cd30>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:04:10.445926 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.wsgi [None req-ebeb153c-15b6-4e30-894c-8861d48f01b1 tempest-VolumesSnapshotsTestJSON-1857672228 tempest-VolumesSnapshotsTestJSON-1857672228-project] HTTP exception thrown: Snapshot af8439af-2073-461f-b06d-6292303a3da6 could not be found. Jul 30 05:04:10.448253 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-ebeb153c-15b6-4e30-894c-8861d48f01b1 tempest-VolumesSnapshotsTestJSON-1857672228 tempest-VolumesSnapshotsTestJSON-1857672228-project] Request method failure captured: Jul 30 05:04:10.448253 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: request: GET /compute/v2.1/os-snapshots/af8439af-2073-461f-b06d-6292303a3da6 HTTP/1.1 Jul 30 05:04:10.448253 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Accept: application/json Jul 30 05:04:10.448253 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Accept-Encoding: identity Jul 30 05:04:10.448253 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Connection: close Jul 30 05:04:10.448253 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Content-Length: 0 Jul 30 05:04:10.448253 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Content-Type: application/json Jul 30 05:04:10.448253 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Host: 10.222.0.20 Jul 30 05:04:10.448253 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Openstack-System-Scope: None Jul 30 05:04:10.448253 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: User-Agent: python-urllib3/1.26.10 Jul 30 05:04:10.448253 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Auth-Token: gAAAAABi5LvEaqLuPxYCEzSsxHvR5kfBrzny-nwiQKhaLxWgfSHjKROC-6tOB0ValYOJD3KBFX2jHx2sGmSp5wgbNZ4x-_8sd-GKFPXmbX2BEoQxpJiYNRaJJkrajtsXoSfzJjz2smOQjoDVA_97gl-0AeboqQKvPZs6NYqMkV-qgIDt8ngrxDg Jul 30 05:04:10.448253 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Domain-Id: None Jul 30 05:04:10.448253 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Domain-Name: None Jul 30 05:04:10.448253 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Identity-Status: Confirmed Jul 30 05:04:10.448253 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Is-Admin-Project: True Jul 30 05:04:10.448253 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Domain-Id: default Jul 30 05:04:10.448253 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Domain-Name: Default Jul 30 05:04:10.448253 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Id: dc7891287dd64eadac8de9cdf8e41b74 Jul 30 05:04:10.448253 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1857672228 Jul 30 05:04:10.448253 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Role: member,reader Jul 30 05:04:10.448253 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Roles: member,reader Jul 30 05:04:10.449856 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dc7891287dd64eadac8de9cdf8e41b74"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dc7891287dd64eadac8de9cdf8e41b74"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_dc7891287dd64eadac8de9cdf8e41b74"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/dc7891287dd64eadac8de9cdf8e41b74"}]}] Jul 30 05:04:10.449856 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1857672228 Jul 30 05:04:10.449856 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Tenant-Id: dc7891287dd64eadac8de9cdf8e41b74 Jul 30 05:04:10.449856 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1857672228 Jul 30 05:04:10.449856 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User: tempest-VolumesSnapshotsTestJSON-1857672228-project Jul 30 05:04:10.449856 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Domain-Id: default Jul 30 05:04:10.449856 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Domain-Name: Default Jul 30 05:04:10.449856 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Id: 3b26db3178574782bee6b7f8fbc15e64 Jul 30 05:04:10.449856 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1857672228-project Jul 30 05:04:10.449856 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: method: Jul 30 05:04:10.449856 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: exception: Snapshot af8439af-2073-461f-b06d-6292303a3da6 could not be found. Jul 30 05:04:10.449856 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: action_args: {'id': 'af8439af-2073-461f-b06d-6292303a3da6'} Jul 30 05:04:10.449856 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 05:04:10.450870 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:04:10.450870 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 30 05:04:10.450870 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 30 05:04:10.450870 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 30 05:04:10.450870 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 30 05:04:10.450870 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 30 05:04:10.450870 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 30 05:04:10.450870 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 30 05:04:10.450870 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 30 05:04:10.450870 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 30 05:04:10.450870 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 30 05:04:10.450870 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 30 05:04:10.450870 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 30 05:04:10.450870 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 30 05:04:10.450870 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 30 05:04:10.450870 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot af8439af-2073-461f-b06d-6292303a3da6 could not be found. (HTTP 404) (Request-ID: req-6f34b437-f846-4b30-9585-721a9b2c9622) Jul 30 05:04:10.450870 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:04:10.450870 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 05:04:10.452201 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:04:10.452201 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:04:10.452201 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 30 05:04:10.452201 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 30 05:04:10.452201 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 30 05:04:10.452201 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 30 05:04:10.452201 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 30 05:04:10.452201 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 30 05:04:10.452201 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 30 05:04:10.452201 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 30 05:04:10.452201 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 30 05:04:10.452201 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 30 05:04:10.452201 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 30 05:04:10.452201 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 30 05:04:10.452201 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 30 05:04:10.452201 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 30 05:04:10.452201 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 30 05:04:10.452201 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 30 05:04:10.452201 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 30 05:04:10.453582 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 30 05:04:10.453582 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 30 05:04:10.453582 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 30 05:04:10.453582 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 30 05:04:10.453582 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 30 05:04:10.453582 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot af8439af-2073-461f-b06d-6292303a3da6 could not be found. Jul 30 05:04:10.453582 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:04:10.453582 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 05:04:10.453582 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:04:10.453582 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:04:10.453582 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 05:04:10.453582 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 05:04:10.453582 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 05:04:10.453582 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 05:04:10.453582 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 05:04:10.453582 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 05:04:10.453582 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 05:04:10.453582 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 05:04:10.453582 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 30 05:04:10.453582 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 05:04:10.455092 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot af8439af-2073-461f-b06d-6292303a3da6 could not be found. Jul 30 05:04:10.455092 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:04:10.455092 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 05:04:10.455092 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:04:10.455092 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:04:10.455092 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 05:04:10.455092 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 05:04:10.455092 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 05:04:10.455092 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 05:04:10.455092 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot af8439af-2073-461f-b06d-6292303a3da6 could not be found. Jul 30 05:04:10.455092 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:04:10.455092 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-ebeb153c-15b6-4e30-894c-8861d48f01b1 tempest-VolumesSnapshotsTestJSON-1857672228 tempest-VolumesSnapshotsTestJSON-1857672228-project] Returning 404 to user: Snapshot af8439af-2073-461f-b06d-6292303a3da6 could not be found. {{(pid=117885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 05:04:10.455092 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-ebeb153c-15b6-4e30-894c-8861d48f01b1 tempest-VolumesSnapshotsTestJSON-1857672228 tempest-VolumesSnapshotsTestJSON-1857672228-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/af8439af-2073-461f-b06d-6292303a3da6" status: 404 len: 111 microversion: 2.1 time: 0.033457 Jul 30 05:04:10.456064 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 430/906] 10.222.0.20 () {58 vars in 1251 bytes} [Sat Jul 30 05:04:10 2022] GET /compute/v2.1/os-snapshots/af8439af-2073-461f-b06d-6292303a3da6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 05:04:10.461516 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-b6f2671c-396b-447d-a82b-4312bee5c6c8 tempest-VolumesSnapshotsTestJSON-1857672228 tempest-VolumesSnapshotsTestJSON-1857672228-project] Calling method '.version_select at 0x7f2db40ecd30>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:04:10.538547 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-b6f2671c-396b-447d-a82b-4312bee5c6c8 tempest-VolumesSnapshotsTestJSON-1857672228 tempest-VolumesSnapshotsTestJSON-1857672228-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/8f875f9e-19ac-467c-b7f9-2271269bdd6b" status: 202 len: 0 microversion: 2.1 time: 0.080629 Jul 30 05:04:10.539165 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 477/907] 10.222.0.20 () {58 vars in 1248 bytes} [Sat Jul 30 05:04:10 2022] DELETE /compute/v2.1/os-volumes/8f875f9e-19ac-467c-b7f9-2271269bdd6b => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 05:04:10.549281 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-c821d8ec-5291-49e4-85ed-f1be6f082e22 tempest-VolumesSnapshotsTestJSON-1857672228 tempest-VolumesSnapshotsTestJSON-1857672228-project] Calling method '.version_select at 0x7f2daf7203a0>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:04:10.598647 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-c821d8ec-5291-49e4-85ed-f1be6f082e22 tempest-VolumesSnapshotsTestJSON-1857672228 tempest-VolumesSnapshotsTestJSON-1857672228-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/8f875f9e-19ac-467c-b7f9-2271269bdd6b" status: 200 len: 344 microversion: 2.1 time: 0.054364 Jul 30 05:04:10.599265 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 431/908] 10.222.0.20 () {58 vars in 1245 bytes} [Sat Jul 30 05:04:10 2022] GET /compute/v2.1/os-volumes/8f875f9e-19ac-467c-b7f9-2271269bdd6b => generated 344 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 05:04:10.624164 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-c94ac41c-6dae-4a6e-8b05-34825a924d7f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:04:10.625173 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-c94ac41c-6dae-4a6e-8b05-34825a924d7f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:04:10.631464 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c94ac41c-6dae-4a6e-8b05-34825a924d7f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:10.631946 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c94ac41c-6dae-4a6e-8b05-34825a924d7f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:10.632718 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c94ac41c-6dae-4a6e-8b05-34825a924d7f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:10.633157 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c94ac41c-6dae-4a6e-8b05-34825a924d7f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:10.847346 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-c94ac41c-6dae-4a6e-8b05-34825a924d7f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:10.855840 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-c94ac41c-6dae-4a6e-8b05-34825a924d7f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:10.857334 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-c94ac41c-6dae-4a6e-8b05-34825a924d7f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:10.858533 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-c94ac41c-6dae-4a6e-8b05-34825a924d7f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b" status: 200 len: 1724 microversion: 2.20 time: 0.238366 Jul 30 05:04:10.859083 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 478/909] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:04:10 2022] GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b => generated 1724 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 05:04:11.613704 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-9af25414-840c-4b97-a65f-5c1d28781e0c tempest-VolumesSnapshotsTestJSON-1857672228 tempest-VolumesSnapshotsTestJSON-1857672228-project] Calling method '.version_select at 0x7f2daf627310>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:04:11.641460 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.wsgi [None req-9af25414-840c-4b97-a65f-5c1d28781e0c tempest-VolumesSnapshotsTestJSON-1857672228 tempest-VolumesSnapshotsTestJSON-1857672228-project] HTTP exception thrown: Volume 8f875f9e-19ac-467c-b7f9-2271269bdd6b could not be found. Jul 30 05:04:11.644204 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-9af25414-840c-4b97-a65f-5c1d28781e0c tempest-VolumesSnapshotsTestJSON-1857672228 tempest-VolumesSnapshotsTestJSON-1857672228-project] Request method failure captured: Jul 30 05:04:11.644204 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: request: GET /compute/v2.1/os-volumes/8f875f9e-19ac-467c-b7f9-2271269bdd6b HTTP/1.1 Jul 30 05:04:11.644204 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Accept: application/json Jul 30 05:04:11.644204 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Accept-Encoding: identity Jul 30 05:04:11.644204 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Connection: close Jul 30 05:04:11.644204 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Content-Length: 0 Jul 30 05:04:11.644204 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Content-Type: application/json Jul 30 05:04:11.644204 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Host: 10.222.0.20 Jul 30 05:04:11.644204 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Openstack-System-Scope: None Jul 30 05:04:11.644204 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: User-Agent: python-urllib3/1.26.10 Jul 30 05:04:11.644204 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Auth-Token: gAAAAABi5LvEaqLuPxYCEzSsxHvR5kfBrzny-nwiQKhaLxWgfSHjKROC-6tOB0ValYOJD3KBFX2jHx2sGmSp5wgbNZ4x-_8sd-GKFPXmbX2BEoQxpJiYNRaJJkrajtsXoSfzJjz2smOQjoDVA_97gl-0AeboqQKvPZs6NYqMkV-qgIDt8ngrxDg Jul 30 05:04:11.644204 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Domain-Id: None Jul 30 05:04:11.644204 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Domain-Name: None Jul 30 05:04:11.644204 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Identity-Status: Confirmed Jul 30 05:04:11.644204 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Is-Admin-Project: True Jul 30 05:04:11.644204 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Domain-Id: default Jul 30 05:04:11.644204 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Domain-Name: Default Jul 30 05:04:11.644204 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Id: dc7891287dd64eadac8de9cdf8e41b74 Jul 30 05:04:11.644204 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1857672228 Jul 30 05:04:11.644204 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Role: member,reader Jul 30 05:04:11.644204 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Roles: member,reader Jul 30 05:04:11.645823 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dc7891287dd64eadac8de9cdf8e41b74"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dc7891287dd64eadac8de9cdf8e41b74"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_dc7891287dd64eadac8de9cdf8e41b74"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/dc7891287dd64eadac8de9cdf8e41b74"}]}] Jul 30 05:04:11.645823 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1857672228 Jul 30 05:04:11.645823 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Tenant-Id: dc7891287dd64eadac8de9cdf8e41b74 Jul 30 05:04:11.645823 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1857672228 Jul 30 05:04:11.645823 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User: tempest-VolumesSnapshotsTestJSON-1857672228-project Jul 30 05:04:11.645823 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Domain-Id: default Jul 30 05:04:11.645823 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Domain-Name: Default Jul 30 05:04:11.645823 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Id: 3b26db3178574782bee6b7f8fbc15e64 Jul 30 05:04:11.645823 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1857672228-project Jul 30 05:04:11.645823 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: method: Jul 30 05:04:11.645823 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: exception: Volume 8f875f9e-19ac-467c-b7f9-2271269bdd6b could not be found. Jul 30 05:04:11.645823 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: action_args: {'id': '8f875f9e-19ac-467c-b7f9-2271269bdd6b'} Jul 30 05:04:11.645823 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 05:04:11.646788 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:04:11.646788 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 30 05:04:11.646788 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 30 05:04:11.646788 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 30 05:04:11.646788 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 30 05:04:11.646788 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 30 05:04:11.646788 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 30 05:04:11.646788 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 30 05:04:11.646788 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 30 05:04:11.646788 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 30 05:04:11.646788 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 30 05:04:11.646788 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 30 05:04:11.646788 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 30 05:04:11.646788 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 30 05:04:11.646788 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 30 05:04:11.646788 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8f875f9e-19ac-467c-b7f9-2271269bdd6b could not be found. (HTTP 404) (Request-ID: req-2d9ff7a6-7fc3-4ed8-b9ff-87419ae0b328) Jul 30 05:04:11.646788 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:04:11.646788 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 05:04:11.646788 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:04:11.648286 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:04:11.648286 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 30 05:04:11.648286 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 30 05:04:11.648286 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 30 05:04:11.648286 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 30 05:04:11.648286 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 30 05:04:11.648286 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 30 05:04:11.648286 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 30 05:04:11.648286 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 30 05:04:11.648286 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 30 05:04:11.648286 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 30 05:04:11.648286 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 30 05:04:11.648286 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 30 05:04:11.648286 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 30 05:04:11.648286 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 30 05:04:11.648286 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 30 05:04:11.648286 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 30 05:04:11.648286 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 30 05:04:11.648286 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 30 05:04:11.649643 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 30 05:04:11.649643 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 30 05:04:11.649643 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 30 05:04:11.649643 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 30 05:04:11.649643 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8f875f9e-19ac-467c-b7f9-2271269bdd6b could not be found. Jul 30 05:04:11.649643 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:04:11.649643 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 05:04:11.649643 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:04:11.649643 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:04:11.649643 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 05:04:11.649643 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 05:04:11.649643 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 05:04:11.649643 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 05:04:11.649643 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 05:04:11.649643 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 05:04:11.649643 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 05:04:11.649643 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 05:04:11.649643 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 30 05:04:11.649643 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 05:04:11.650923 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8f875f9e-19ac-467c-b7f9-2271269bdd6b could not be found. Jul 30 05:04:11.650923 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:04:11.650923 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 05:04:11.650923 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:04:11.650923 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:04:11.650923 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 05:04:11.650923 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 05:04:11.650923 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 05:04:11.650923 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 05:04:11.650923 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8f875f9e-19ac-467c-b7f9-2271269bdd6b could not be found. Jul 30 05:04:11.650923 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:04:11.650923 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-9af25414-840c-4b97-a65f-5c1d28781e0c tempest-VolumesSnapshotsTestJSON-1857672228 tempest-VolumesSnapshotsTestJSON-1857672228-project] Returning 404 to user: Volume 8f875f9e-19ac-467c-b7f9-2271269bdd6b could not be found. {{(pid=117885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 05:04:11.650923 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-9af25414-840c-4b97-a65f-5c1d28781e0c tempest-VolumesSnapshotsTestJSON-1857672228 tempest-VolumesSnapshotsTestJSON-1857672228-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/8f875f9e-19ac-467c-b7f9-2271269bdd6b" status: 404 len: 109 microversion: 2.1 time: 0.037236 Jul 30 05:04:11.650923 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 432/910] 10.222.0.20 () {58 vars in 1245 bytes} [Sat Jul 30 05:04:11 2022] GET /compute/v2.1/os-volumes/8f875f9e-19ac-467c-b7f9-2271269bdd6b => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 05:04:11.661319 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-46824fb3-bc46-4b1b-86a4-c724d5258b7e tempest-VolumesSnapshotsTestJSON-1857672228 tempest-VolumesSnapshotsTestJSON-1857672228-project] Calling method '.version_select at 0x7f2daf6abca0>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:04:11.692619 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.wsgi [None req-46824fb3-bc46-4b1b-86a4-c724d5258b7e tempest-VolumesSnapshotsTestJSON-1857672228 tempest-VolumesSnapshotsTestJSON-1857672228-project] HTTP exception thrown: Volume 8f875f9e-19ac-467c-b7f9-2271269bdd6b could not be found. Jul 30 05:04:11.694813 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-46824fb3-bc46-4b1b-86a4-c724d5258b7e tempest-VolumesSnapshotsTestJSON-1857672228 tempest-VolumesSnapshotsTestJSON-1857672228-project] Request method failure captured: Jul 30 05:04:11.694813 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: request: DELETE /compute/v2.1/os-volumes/8f875f9e-19ac-467c-b7f9-2271269bdd6b HTTP/1.1 Jul 30 05:04:11.694813 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Accept: application/json Jul 30 05:04:11.694813 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Accept-Encoding: identity Jul 30 05:04:11.694813 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Connection: close Jul 30 05:04:11.694813 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Content-Length: 0 Jul 30 05:04:11.694813 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Content-Type: application/json Jul 30 05:04:11.694813 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Host: 10.222.0.20 Jul 30 05:04:11.694813 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Openstack-System-Scope: None Jul 30 05:04:11.694813 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: User-Agent: python-urllib3/1.26.10 Jul 30 05:04:11.694813 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Auth-Token: gAAAAABi5LvEaqLuPxYCEzSsxHvR5kfBrzny-nwiQKhaLxWgfSHjKROC-6tOB0ValYOJD3KBFX2jHx2sGmSp5wgbNZ4x-_8sd-GKFPXmbX2BEoQxpJiYNRaJJkrajtsXoSfzJjz2smOQjoDVA_97gl-0AeboqQKvPZs6NYqMkV-qgIDt8ngrxDg Jul 30 05:04:11.694813 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Domain-Id: None Jul 30 05:04:11.694813 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Domain-Name: None Jul 30 05:04:11.694813 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Identity-Status: Confirmed Jul 30 05:04:11.694813 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Is-Admin-Project: True Jul 30 05:04:11.694813 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Project-Domain-Id: default Jul 30 05:04:11.694813 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Project-Domain-Name: Default Jul 30 05:04:11.694813 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Project-Id: dc7891287dd64eadac8de9cdf8e41b74 Jul 30 05:04:11.694813 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1857672228 Jul 30 05:04:11.694813 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Role: member,reader Jul 30 05:04:11.694813 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Roles: member,reader Jul 30 05:04:11.696402 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dc7891287dd64eadac8de9cdf8e41b74"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dc7891287dd64eadac8de9cdf8e41b74"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_dc7891287dd64eadac8de9cdf8e41b74"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/dc7891287dd64eadac8de9cdf8e41b74"}]}] Jul 30 05:04:11.696402 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1857672228 Jul 30 05:04:11.696402 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Tenant-Id: dc7891287dd64eadac8de9cdf8e41b74 Jul 30 05:04:11.696402 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1857672228 Jul 30 05:04:11.696402 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User: tempest-VolumesSnapshotsTestJSON-1857672228-project Jul 30 05:04:11.696402 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User-Domain-Id: default Jul 30 05:04:11.696402 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User-Domain-Name: Default Jul 30 05:04:11.696402 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User-Id: 3b26db3178574782bee6b7f8fbc15e64 Jul 30 05:04:11.696402 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1857672228-project Jul 30 05:04:11.696402 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: method: Jul 30 05:04:11.696402 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: exception: Volume 8f875f9e-19ac-467c-b7f9-2271269bdd6b could not be found. Jul 30 05:04:11.696402 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: action_args: {'id': '8f875f9e-19ac-467c-b7f9-2271269bdd6b'} Jul 30 05:04:11.696402 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 05:04:11.697403 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:04:11.697403 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 30 05:04:11.697403 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 30 05:04:11.697403 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 30 05:04:11.697403 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 30 05:04:11.697403 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 30 05:04:11.697403 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 30 05:04:11.697403 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 30 05:04:11.697403 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 30 05:04:11.697403 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 30 05:04:11.697403 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 30 05:04:11.697403 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 30 05:04:11.697403 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 30 05:04:11.697403 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 30 05:04:11.697403 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 30 05:04:11.697403 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8f875f9e-19ac-467c-b7f9-2271269bdd6b could not be found. (HTTP 404) (Request-ID: req-305f5a32-2a50-4c34-bd42-1f2330341a9f) Jul 30 05:04:11.697403 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 05:04:11.697403 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 05:04:11.697403 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 05:04:11.698826 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:04:11.698826 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 30 05:04:11.698826 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 30 05:04:11.698826 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 30 05:04:11.698826 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 30 05:04:11.698826 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 30 05:04:11.698826 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 30 05:04:11.698826 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 30 05:04:11.698826 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 30 05:04:11.698826 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 30 05:04:11.698826 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 30 05:04:11.698826 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 30 05:04:11.698826 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 30 05:04:11.698826 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 30 05:04:11.698826 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 30 05:04:11.698826 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 30 05:04:11.698826 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 30 05:04:11.698826 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 30 05:04:11.698826 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 30 05:04:11.700191 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 30 05:04:11.700191 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 30 05:04:11.700191 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 30 05:04:11.700191 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 30 05:04:11.700191 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8f875f9e-19ac-467c-b7f9-2271269bdd6b could not be found. Jul 30 05:04:11.700191 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 05:04:11.700191 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 05:04:11.700191 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 05:04:11.700191 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:04:11.700191 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 05:04:11.700191 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 05:04:11.700191 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 05:04:11.700191 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 05:04:11.700191 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 05:04:11.700191 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 05:04:11.700191 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 05:04:11.700191 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 05:04:11.700191 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 30 05:04:11.700191 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 05:04:11.704629 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8f875f9e-19ac-467c-b7f9-2271269bdd6b could not be found. Jul 30 05:04:11.704629 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 05:04:11.704629 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 05:04:11.704629 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 05:04:11.704629 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:04:11.704629 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 05:04:11.704629 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 05:04:11.704629 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 05:04:11.704629 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 05:04:11.704629 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8f875f9e-19ac-467c-b7f9-2271269bdd6b could not be found. Jul 30 05:04:11.704629 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 05:04:11.704629 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-46824fb3-bc46-4b1b-86a4-c724d5258b7e tempest-VolumesSnapshotsTestJSON-1857672228 tempest-VolumesSnapshotsTestJSON-1857672228-project] Returning 404 to user: Volume 8f875f9e-19ac-467c-b7f9-2271269bdd6b could not be found. {{(pid=117886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 05:04:11.704629 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-46824fb3-bc46-4b1b-86a4-c724d5258b7e tempest-VolumesSnapshotsTestJSON-1857672228 tempest-VolumesSnapshotsTestJSON-1857672228-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/8f875f9e-19ac-467c-b7f9-2271269bdd6b" status: 404 len: 109 microversion: 2.1 time: 0.041015 Jul 30 05:04:11.704629 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 479/911] 10.222.0.20 () {58 vars in 1248 bytes} [Sat Jul 30 05:04:11 2022] DELETE /compute/v2.1/os-volumes/8f875f9e-19ac-467c-b7f9-2271269bdd6b => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 05:04:11.709997 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-2f61f3b1-3043-4aad-926b-e5cb4f15d844 tempest-VolumesSnapshotsTestJSON-1857672228 tempest-VolumesSnapshotsTestJSON-1857672228-project] Calling method '.version_select at 0x7f2daf720d30>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:04:11.738054 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.wsgi [None req-2f61f3b1-3043-4aad-926b-e5cb4f15d844 tempest-VolumesSnapshotsTestJSON-1857672228 tempest-VolumesSnapshotsTestJSON-1857672228-project] HTTP exception thrown: Volume 8f875f9e-19ac-467c-b7f9-2271269bdd6b could not be found. Jul 30 05:04:11.740053 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-2f61f3b1-3043-4aad-926b-e5cb4f15d844 tempest-VolumesSnapshotsTestJSON-1857672228 tempest-VolumesSnapshotsTestJSON-1857672228-project] Request method failure captured: Jul 30 05:04:11.740053 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: request: GET /compute/v2.1/os-volumes/8f875f9e-19ac-467c-b7f9-2271269bdd6b HTTP/1.1 Jul 30 05:04:11.740053 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Accept: application/json Jul 30 05:04:11.740053 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Accept-Encoding: identity Jul 30 05:04:11.740053 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Connection: close Jul 30 05:04:11.740053 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Content-Length: 0 Jul 30 05:04:11.740053 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Content-Type: application/json Jul 30 05:04:11.740053 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Host: 10.222.0.20 Jul 30 05:04:11.740053 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Openstack-System-Scope: None Jul 30 05:04:11.740053 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: User-Agent: python-urllib3/1.26.10 Jul 30 05:04:11.740053 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Auth-Token: gAAAAABi5LvEaqLuPxYCEzSsxHvR5kfBrzny-nwiQKhaLxWgfSHjKROC-6tOB0ValYOJD3KBFX2jHx2sGmSp5wgbNZ4x-_8sd-GKFPXmbX2BEoQxpJiYNRaJJkrajtsXoSfzJjz2smOQjoDVA_97gl-0AeboqQKvPZs6NYqMkV-qgIDt8ngrxDg Jul 30 05:04:11.740053 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Domain-Id: None Jul 30 05:04:11.740053 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Domain-Name: None Jul 30 05:04:11.740053 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Identity-Status: Confirmed Jul 30 05:04:11.740053 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Is-Admin-Project: True Jul 30 05:04:11.740053 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Domain-Id: default Jul 30 05:04:11.740053 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Domain-Name: Default Jul 30 05:04:11.740053 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Id: dc7891287dd64eadac8de9cdf8e41b74 Jul 30 05:04:11.740053 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1857672228 Jul 30 05:04:11.740053 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Role: member,reader Jul 30 05:04:11.740053 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Roles: member,reader Jul 30 05:04:11.741604 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dc7891287dd64eadac8de9cdf8e41b74"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dc7891287dd64eadac8de9cdf8e41b74"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_dc7891287dd64eadac8de9cdf8e41b74"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/dc7891287dd64eadac8de9cdf8e41b74"}]}] Jul 30 05:04:11.741604 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1857672228 Jul 30 05:04:11.741604 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Tenant-Id: dc7891287dd64eadac8de9cdf8e41b74 Jul 30 05:04:11.741604 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1857672228 Jul 30 05:04:11.741604 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User: tempest-VolumesSnapshotsTestJSON-1857672228-project Jul 30 05:04:11.741604 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Domain-Id: default Jul 30 05:04:11.741604 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Domain-Name: Default Jul 30 05:04:11.741604 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Id: 3b26db3178574782bee6b7f8fbc15e64 Jul 30 05:04:11.741604 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1857672228-project Jul 30 05:04:11.741604 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: method: Jul 30 05:04:11.741604 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: exception: Volume 8f875f9e-19ac-467c-b7f9-2271269bdd6b could not be found. Jul 30 05:04:11.741604 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: action_args: {'id': '8f875f9e-19ac-467c-b7f9-2271269bdd6b'} Jul 30 05:04:11.741604 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 05:04:11.742551 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:04:11.742551 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 30 05:04:11.742551 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 30 05:04:11.742551 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 30 05:04:11.742551 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 30 05:04:11.742551 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 30 05:04:11.742551 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 30 05:04:11.742551 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 30 05:04:11.742551 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 30 05:04:11.742551 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 30 05:04:11.742551 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 30 05:04:11.742551 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 30 05:04:11.742551 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 30 05:04:11.742551 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 30 05:04:11.742551 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 30 05:04:11.742551 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8f875f9e-19ac-467c-b7f9-2271269bdd6b could not be found. (HTTP 404) (Request-ID: req-09c2b918-bc2e-4f0b-ad23-0df6736208da) Jul 30 05:04:11.742551 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:04:11.742551 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 05:04:11.742551 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:04:11.747010 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:04:11.747010 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 30 05:04:11.747010 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 30 05:04:11.747010 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 30 05:04:11.747010 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 30 05:04:11.747010 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 30 05:04:11.747010 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 30 05:04:11.747010 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 30 05:04:11.747010 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 30 05:04:11.747010 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 30 05:04:11.747010 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 30 05:04:11.747010 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 30 05:04:11.747010 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 30 05:04:11.747010 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 30 05:04:11.747010 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 30 05:04:11.747010 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 30 05:04:11.747010 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 30 05:04:11.747010 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 30 05:04:11.747010 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 30 05:04:11.748867 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 30 05:04:11.748867 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 30 05:04:11.748867 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 30 05:04:11.748867 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 30 05:04:11.748867 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8f875f9e-19ac-467c-b7f9-2271269bdd6b could not be found. Jul 30 05:04:11.748867 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:04:11.748867 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 05:04:11.748867 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:04:11.748867 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:04:11.748867 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 05:04:11.748867 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 05:04:11.748867 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 05:04:11.748867 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 05:04:11.748867 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 30 05:04:11.748867 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 30 05:04:11.748867 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 05:04:11.748867 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 05:04:11.748867 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 30 05:04:11.748867 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 05:04:11.750162 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8f875f9e-19ac-467c-b7f9-2271269bdd6b could not be found. Jul 30 05:04:11.750162 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:04:11.750162 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 05:04:11.750162 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:04:11.750162 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:04:11.750162 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 05:04:11.750162 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 05:04:11.750162 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 05:04:11.750162 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 05:04:11.750162 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8f875f9e-19ac-467c-b7f9-2271269bdd6b could not be found. Jul 30 05:04:11.750162 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:04:11.750162 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-2f61f3b1-3043-4aad-926b-e5cb4f15d844 tempest-VolumesSnapshotsTestJSON-1857672228 tempest-VolumesSnapshotsTestJSON-1857672228-project] Returning 404 to user: Volume 8f875f9e-19ac-467c-b7f9-2271269bdd6b could not be found. {{(pid=117885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 05:04:11.750162 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-2f61f3b1-3043-4aad-926b-e5cb4f15d844 tempest-VolumesSnapshotsTestJSON-1857672228 tempest-VolumesSnapshotsTestJSON-1857672228-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/8f875f9e-19ac-467c-b7f9-2271269bdd6b" status: 404 len: 109 microversion: 2.1 time: 0.035822 Jul 30 05:04:11.750162 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 433/912] 10.222.0.20 () {58 vars in 1245 bytes} [Sat Jul 30 05:04:11 2022] GET /compute/v2.1/os-volumes/8f875f9e-19ac-467c-b7f9-2271269bdd6b => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 05:04:11.882036 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-5988972b-7626-420f-8452-5ea59a800a4e tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:04:11.883387 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-5988972b-7626-420f-8452-5ea59a800a4e tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:04:11.889435 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5988972b-7626-420f-8452-5ea59a800a4e tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:11.889893 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5988972b-7626-420f-8452-5ea59a800a4e tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:11.890700 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5988972b-7626-420f-8452-5ea59a800a4e tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:11.891133 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5988972b-7626-420f-8452-5ea59a800a4e tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:12.130520 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-5988972b-7626-420f-8452-5ea59a800a4e tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:12.138987 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-5988972b-7626-420f-8452-5ea59a800a4e tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:12.140644 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-5988972b-7626-420f-8452-5ea59a800a4e tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:12.142403 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-5988972b-7626-420f-8452-5ea59a800a4e tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b" status: 200 len: 1724 microversion: 2.20 time: 0.263691 Jul 30 05:04:12.143361 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 480/913] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:04:11 2022] GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b => generated 1724 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 05:04:12.387092 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-e76ce255-e8bb-4bae-8e03-9d868ca23e4c req-0e5ef09a-d4dd-4ecc-9c0d-80451a2c8ed2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0faad1c9-0b0d-44af-92cb-dd0acd61c755", "tag": "abedbf31-d88b-46bc-a1ef-33a68dcc3b21"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:04:12.405817 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-e76ce255-e8bb-4bae-8e03-9d868ca23e4c req-0e5ef09a-d4dd-4ecc-9c0d-80451a2c8ed2 service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:12.407017 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-e76ce255-e8bb-4bae-8e03-9d868ca23e4c req-0e5ef09a-d4dd-4ecc-9c0d-80451a2c8ed2 service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:12.429197 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-e76ce255-e8bb-4bae-8e03-9d868ca23e4c req-0e5ef09a-d4dd-4ecc-9c0d-80451a2c8ed2 service nova] Creating event network-changed:abedbf31-d88b-46bc-a1ef-33a68dcc3b21 for instance 0faad1c9-0b0d-44af-92cb-dd0acd61c755 on hv-cinder-85127 Jul 30 05:04:12.437130 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-e76ce255-e8bb-4bae-8e03-9d868ca23e4c req-0e5ef09a-d4dd-4ecc-9c0d-80451a2c8ed2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054653 Jul 30 05:04:12.438709 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 434/914] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Jul 30 05:04:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 05:04:13.165020 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-95065619-21d1-4755-a57d-28c093348cb4 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:04:13.165633 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-95065619-21d1-4755-a57d-28c093348cb4 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:04:13.168483 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=98,nova_api:UPDATE=1 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:04:13.176139 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-95065619-21d1-4755-a57d-28c093348cb4 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:13.176842 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-95065619-21d1-4755-a57d-28c093348cb4 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:13.178071 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-95065619-21d1-4755-a57d-28c093348cb4 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:13.179448 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-95065619-21d1-4755-a57d-28c093348cb4 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:13.210278 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:04:13.352539 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-95065619-21d1-4755-a57d-28c093348cb4 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:13.363118 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-95065619-21d1-4755-a57d-28c093348cb4 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:13.364686 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-95065619-21d1-4755-a57d-28c093348cb4 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:13.366023 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-95065619-21d1-4755-a57d-28c093348cb4 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b" status: 200 len: 1724 microversion: 2.20 time: 0.204757 Jul 30 05:04:13.379183 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 481/915] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:04:13 2022] GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b => generated 1724 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 05:04:13.681827 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-2497647f-6168-41c3-a52d-71b29a656db3 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-326776392"}} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:04:13.682627 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-2497647f-6168-41c3-a52d-71b29a656db3 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] [instance: 0faad1c9-0b0d-44af-92cb-dd0acd61c755] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:04:13.692167 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2497647f-6168-41c3-a52d-71b29a656db3 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:13.692621 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2497647f-6168-41c3-a52d-71b29a656db3 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:13.693446 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2497647f-6168-41c3-a52d-71b29a656db3 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:13.694238 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2497647f-6168-41c3-a52d-71b29a656db3 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:13.841751 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.network.security_group_api [None req-2497647f-6168-41c3-a52d-71b29a656db3 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Adding security group c2e8fdbe-c42e-4a4b-bfe5-089c4b11466f to port abedbf31-d88b-46bc-a1ef-33a68dcc3b21 Jul 30 05:04:14.169746 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-2497647f-6168-41c3-a52d-71b29a656db3 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] 10.222.0.20 "POST /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755/action" status: 202 len: 0 microversion: 2.1 time: 0.493083 Jul 30 05:04:14.174787 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 435/916] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Jul 30 05:04:13 2022] POST /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755/action => generated 0 bytes in 495 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 05:04:14.180165 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-3ccdcd8f-e7f9-4cac-b0d2-bb916185d3b0 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:04:14.180787 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-3ccdcd8f-e7f9-4cac-b0d2-bb916185d3b0 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] [instance: 0faad1c9-0b0d-44af-92cb-dd0acd61c755] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:04:14.187567 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3ccdcd8f-e7f9-4cac-b0d2-bb916185d3b0 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:14.188026 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3ccdcd8f-e7f9-4cac-b0d2-bb916185d3b0 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:14.189614 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3ccdcd8f-e7f9-4cac-b0d2-bb916185d3b0 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:14.190180 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3ccdcd8f-e7f9-4cac-b0d2-bb916185d3b0 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:14.199224 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-497753bd-3b6f-42b7-8fb1-dbcbedcb1873 req-f9c03271-2338-4c3d-8b99-200bd636f613 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0faad1c9-0b0d-44af-92cb-dd0acd61c755", "tag": "abedbf31-d88b-46bc-a1ef-33a68dcc3b21"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:04:14.211829 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-497753bd-3b6f-42b7-8fb1-dbcbedcb1873 req-f9c03271-2338-4c3d-8b99-200bd636f613 service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:14.212273 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-497753bd-3b6f-42b7-8fb1-dbcbedcb1873 req-f9c03271-2338-4c3d-8b99-200bd636f613 service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:14.226181 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-497753bd-3b6f-42b7-8fb1-dbcbedcb1873 req-f9c03271-2338-4c3d-8b99-200bd636f613 service nova] Creating event network-changed:abedbf31-d88b-46bc-a1ef-33a68dcc3b21 for instance 0faad1c9-0b0d-44af-92cb-dd0acd61c755 on hv-cinder-85127 Jul 30 05:04:14.242513 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-497753bd-3b6f-42b7-8fb1-dbcbedcb1873 req-f9c03271-2338-4c3d-8b99-200bd636f613 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047638 Jul 30 05:04:14.243656 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 436/917] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Jul 30 05:04:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 05:04:14.392331 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-a1b072d8-faf3-4d1c-9efd-7fb66b2a3235 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:04:14.393548 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-a1b072d8-faf3-4d1c-9efd-7fb66b2a3235 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:04:14.401270 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a1b072d8-faf3-4d1c-9efd-7fb66b2a3235 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:14.402404 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a1b072d8-faf3-4d1c-9efd-7fb66b2a3235 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:14.403719 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a1b072d8-faf3-4d1c-9efd-7fb66b2a3235 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:14.405279 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a1b072d8-faf3-4d1c-9efd-7fb66b2a3235 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:14.431749 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-3ccdcd8f-e7f9-4cac-b0d2-bb916185d3b0 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42d3708ddfcc491cb366054dcd5f8881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abbb209e2c194596bb3e8b9a6880646e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:14.444663 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-3ccdcd8f-e7f9-4cac-b0d2-bb916185d3b0 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] 10.222.0.20 "GET /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755" status: 200 len: 1758 microversion: 2.1 time: 0.268204 Jul 30 05:04:14.451903 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 482/918] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:04:14 2022] GET /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755 => generated 1758 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:04:14.651844 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-a1b072d8-faf3-4d1c-9efd-7fb66b2a3235 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:14.665816 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-a1b072d8-faf3-4d1c-9efd-7fb66b2a3235 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:14.670942 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-a1b072d8-faf3-4d1c-9efd-7fb66b2a3235 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:14.673283 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-a1b072d8-faf3-4d1c-9efd-7fb66b2a3235 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b" status: 200 len: 1724 microversion: 2.20 time: 0.287284 Jul 30 05:04:14.678870 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 437/919] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:04:14 2022] GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b => generated 1724 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 05:04:15.697985 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-255e3c2f-2c91-411b-a19a-351459341d10 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:04:15.698626 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-255e3c2f-2c91-411b-a19a-351459341d10 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:04:15.705358 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-255e3c2f-2c91-411b-a19a-351459341d10 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:15.705809 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-255e3c2f-2c91-411b-a19a-351459341d10 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:15.706687 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-255e3c2f-2c91-411b-a19a-351459341d10 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:15.707119 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-255e3c2f-2c91-411b-a19a-351459341d10 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:15.856441 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-255e3c2f-2c91-411b-a19a-351459341d10 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:15.864593 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-255e3c2f-2c91-411b-a19a-351459341d10 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:15.866027 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-255e3c2f-2c91-411b-a19a-351459341d10 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:15.867220 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-255e3c2f-2c91-411b-a19a-351459341d10 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b" status: 200 len: 1745 microversion: 2.20 time: 0.172996 Jul 30 05:04:15.867760 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 483/920] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:04:15 2022] GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b => generated 1745 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 05:04:16.891309 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-f471e260-9289-4ad5-884d-6e44f074f420 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:04:16.891869 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-f471e260-9289-4ad5-884d-6e44f074f420 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:04:16.899249 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f471e260-9289-4ad5-884d-6e44f074f420 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:16.899701 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f471e260-9289-4ad5-884d-6e44f074f420 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:16.900475 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f471e260-9289-4ad5-884d-6e44f074f420 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:16.900914 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f471e260-9289-4ad5-884d-6e44f074f420 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:17.217862 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-f471e260-9289-4ad5-884d-6e44f074f420 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:17.228170 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-f471e260-9289-4ad5-884d-6e44f074f420 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:17.229750 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-f471e260-9289-4ad5-884d-6e44f074f420 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:17.231126 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-f471e260-9289-4ad5-884d-6e44f074f420 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b" status: 200 len: 1745 microversion: 2.20 time: 0.343607 Jul 30 05:04:17.231865 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 438/921] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:04:16 2022] GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b => generated 1745 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 05:04:18.268775 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-d27e510b-c994-440a-adbc-00360509a50f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:04:18.271828 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-d27e510b-c994-440a-adbc-00360509a50f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:04:18.287284 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d27e510b-c994-440a-adbc-00360509a50f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:18.288311 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d27e510b-c994-440a-adbc-00360509a50f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:18.289296 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d27e510b-c994-440a-adbc-00360509a50f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:18.290060 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d27e510b-c994-440a-adbc-00360509a50f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:18.473320 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-d27e510b-c994-440a-adbc-00360509a50f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:18.481872 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-d27e510b-c994-440a-adbc-00360509a50f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:18.484398 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-d27e510b-c994-440a-adbc-00360509a50f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:18.485580 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-d27e510b-c994-440a-adbc-00360509a50f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b" status: 200 len: 1740 microversion: 2.20 time: 0.233462 Jul 30 05:04:18.486883 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 484/922] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:04:18 2022] GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b => generated 1740 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 05:04:19.506659 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-b0a937cf-d773-4bdb-9eed-6fd319569bb4 req-1b5c04d3-56cf-4658-a201-09df6bd9c121 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b", "name": "network-vif-plugged", "status": "completed", "tag": "6ca5af71-3aff-4af4-9271-ac47c637cc34"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:04:19.520520 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-932ef028-d354-4968-b0f9-5660c066f305 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:04:19.522144 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-932ef028-d354-4968-b0f9-5660c066f305 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:04:19.523485 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-b0a937cf-d773-4bdb-9eed-6fd319569bb4 req-1b5c04d3-56cf-4658-a201-09df6bd9c121 service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:19.523990 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-b0a937cf-d773-4bdb-9eed-6fd319569bb4 req-1b5c04d3-56cf-4658-a201-09df6bd9c121 service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:19.533623 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-932ef028-d354-4968-b0f9-5660c066f305 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:19.534076 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-932ef028-d354-4968-b0f9-5660c066f305 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:19.535063 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-932ef028-d354-4968-b0f9-5660c066f305 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:19.535664 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-932ef028-d354-4968-b0f9-5660c066f305 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:19.540327 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-b0a937cf-d773-4bdb-9eed-6fd319569bb4 req-1b5c04d3-56cf-4658-a201-09df6bd9c121 service nova] Creating event network-vif-plugged:6ca5af71-3aff-4af4-9271-ac47c637cc34 for instance b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b on hv-cinder-85127 Jul 30 05:04:19.545996 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-b0a937cf-d773-4bdb-9eed-6fd319569bb4 req-1b5c04d3-56cf-4658-a201-09df6bd9c121 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.203821 Jul 30 05:04:19.546982 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 439/923] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Jul 30 05:04:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 05:04:19.695967 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-932ef028-d354-4968-b0f9-5660c066f305 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:19.705175 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-932ef028-d354-4968-b0f9-5660c066f305 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:19.706717 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-932ef028-d354-4968-b0f9-5660c066f305 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:19.707955 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-932ef028-d354-4968-b0f9-5660c066f305 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b" status: 200 len: 1740 microversion: 2.20 time: 0.195609 Jul 30 05:04:19.708506 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 485/924] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:04:19 2022] GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b => generated 1740 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 05:04:20.735056 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-97e9bba4-fdbd-4939-87e1-f5a1b3ebf4f0 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:04:20.735818 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-97e9bba4-fdbd-4939-87e1-f5a1b3ebf4f0 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:04:20.743974 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-97e9bba4-fdbd-4939-87e1-f5a1b3ebf4f0 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:20.744462 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-97e9bba4-fdbd-4939-87e1-f5a1b3ebf4f0 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:20.745274 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-97e9bba4-fdbd-4939-87e1-f5a1b3ebf4f0 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:20.745721 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-97e9bba4-fdbd-4939-87e1-f5a1b3ebf4f0 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:20.908885 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-97e9bba4-fdbd-4939-87e1-f5a1b3ebf4f0 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:20.919546 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-97e9bba4-fdbd-4939-87e1-f5a1b3ebf4f0 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:20.921706 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-97e9bba4-fdbd-4939-87e1-f5a1b3ebf4f0 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:20.923139 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-97e9bba4-fdbd-4939-87e1-f5a1b3ebf4f0 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b" status: 200 len: 1740 microversion: 2.20 time: 0.193130 Jul 30 05:04:20.924101 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 440/925] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:04:20 2022] GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b => generated 1740 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 05:04:21.951717 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-c49e78fa-0d7a-4243-95e9-2ef6fb4ab02e tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:04:21.951717 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-c49e78fa-0d7a-4243-95e9-2ef6fb4ab02e tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:04:21.964603 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c49e78fa-0d7a-4243-95e9-2ef6fb4ab02e tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:21.965063 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c49e78fa-0d7a-4243-95e9-2ef6fb4ab02e tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:21.967304 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c49e78fa-0d7a-4243-95e9-2ef6fb4ab02e tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:21.968003 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c49e78fa-0d7a-4243-95e9-2ef6fb4ab02e tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:22.155491 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-c49e78fa-0d7a-4243-95e9-2ef6fb4ab02e tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:22.166073 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-c49e78fa-0d7a-4243-95e9-2ef6fb4ab02e tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:22.167882 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-c49e78fa-0d7a-4243-95e9-2ef6fb4ab02e tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:22.169131 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-c49e78fa-0d7a-4243-95e9-2ef6fb4ab02e tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b" status: 200 len: 1740 microversion: 2.20 time: 0.222661 Jul 30 05:04:22.183141 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 486/926] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:04:21 2022] GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b => generated 1740 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 05:04:23.195719 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-0e1b2eea-b81f-4126-acff-bb1b04b368c7 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:04:23.197181 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-0e1b2eea-b81f-4126-acff-bb1b04b368c7 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:04:23.205971 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_api:SELECT=64 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:04:23.209089 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0e1b2eea-b81f-4126-acff-bb1b04b368c7 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:23.210563 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0e1b2eea-b81f-4126-acff-bb1b04b368c7 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:23.211346 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0e1b2eea-b81f-4126-acff-bb1b04b368c7 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:23.212883 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0e1b2eea-b81f-4126-acff-bb1b04b368c7 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:23.386627 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-0e1b2eea-b81f-4126-acff-bb1b04b368c7 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:23.399027 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-0e1b2eea-b81f-4126-acff-bb1b04b368c7 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:23.400576 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-0e1b2eea-b81f-4126-acff-bb1b04b368c7 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:23.401819 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-0e1b2eea-b81f-4126-acff-bb1b04b368c7 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b" status: 200 len: 1740 microversion: 2.20 time: 0.210194 Jul 30 05:04:23.408777 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 441/927] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:04:23 2022] GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b => generated 1740 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 05:04:23.792451 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-0beb5be7-cc16-4cda-a4ca-77e159d4947d tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:04:23.793053 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-0beb5be7-cc16-4cda-a4ca-77e159d4947d tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] [instance: 267d974a-0a42-4e11-ada0-68e101c4a48f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:04:23.803289 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0beb5be7-cc16-4cda-a4ca-77e159d4947d tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:23.807046 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0beb5be7-cc16-4cda-a4ca-77e159d4947d tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:23.808330 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0beb5be7-cc16-4cda-a4ca-77e159d4947d tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:23.809051 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0beb5be7-cc16-4cda-a4ca-77e159d4947d tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:24.025715 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-0beb5be7-cc16-4cda-a4ca-77e159d4947d tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] [instance: 267d974a-0a42-4e11-ada0-68e101c4a48f] Going to try to terminate instance {{(pid=117886) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 05:04:24.138065 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-0beb5be7-cc16-4cda-a4ca-77e159d4947d tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] 10.222.0.20 "DELETE /compute/v2.1/servers/267d974a-0a42-4e11-ada0-68e101c4a48f" status: 204 len: 0 microversion: 2.1 time: 0.349748 Jul 30 05:04:24.139033 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 487/928] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Jul 30 05:04:23 2022] DELETE /compute/v2.1/servers/267d974a-0a42-4e11-ada0-68e101c4a48f => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 05:04:24.148244 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-ca74f957-95ea-49d6-8af7-21cfac2e0415 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:04:24.149323 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-ca74f957-95ea-49d6-8af7-21cfac2e0415 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] [instance: 267d974a-0a42-4e11-ada0-68e101c4a48f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:04:24.167656 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ca74f957-95ea-49d6-8af7-21cfac2e0415 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:24.169686 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ca74f957-95ea-49d6-8af7-21cfac2e0415 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:24.171021 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ca74f957-95ea-49d6-8af7-21cfac2e0415 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:24.171832 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ca74f957-95ea-49d6-8af7-21cfac2e0415 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:24.372430 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-ca74f957-95ea-49d6-8af7-21cfac2e0415 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407ad282edd74fb1adf62fb63306779c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db365a6a9f6041a7a8749fd1a1e3d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:24.386007 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-ca74f957-95ea-49d6-8af7-21cfac2e0415 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] 10.222.0.20 "GET /compute/v2.1/servers/267d974a-0a42-4e11-ada0-68e101c4a48f" status: 200 len: 1574 microversion: 2.1 time: 0.241969 Jul 30 05:04:24.387222 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 442/929] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:04:24 2022] GET /compute/v2.1/servers/267d974a-0a42-4e11-ada0-68e101c4a48f => generated 1574 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:04:24.428194 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-f2e20151-d5a5-4c66-a30f-8da617c3d84f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:04:24.430185 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-f2e20151-d5a5-4c66-a30f-8da617c3d84f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:04:24.436729 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f2e20151-d5a5-4c66-a30f-8da617c3d84f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:24.437384 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f2e20151-d5a5-4c66-a30f-8da617c3d84f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:24.438363 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f2e20151-d5a5-4c66-a30f-8da617c3d84f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:24.439259 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f2e20151-d5a5-4c66-a30f-8da617c3d84f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:24.629208 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-f2e20151-d5a5-4c66-a30f-8da617c3d84f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:24.638718 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-f2e20151-d5a5-4c66-a30f-8da617c3d84f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:24.640589 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-f2e20151-d5a5-4c66-a30f-8da617c3d84f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:24.642729 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-f2e20151-d5a5-4c66-a30f-8da617c3d84f tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b" status: 200 len: 1740 microversion: 2.20 time: 0.219909 Jul 30 05:04:24.643953 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 488/930] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:04:24 2022] GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b => generated 1740 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 05:04:25.415608 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-3c561a64-ce66-4f30-aba4-f285657c7bdc tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:04:25.427148 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-3c561a64-ce66-4f30-aba4-f285657c7bdc tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] [instance: 267d974a-0a42-4e11-ada0-68e101c4a48f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:04:25.445501 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3c561a64-ce66-4f30-aba4-f285657c7bdc tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:25.446417 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3c561a64-ce66-4f30-aba4-f285657c7bdc tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:25.448667 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3c561a64-ce66-4f30-aba4-f285657c7bdc tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:25.449276 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3c561a64-ce66-4f30-aba4-f285657c7bdc tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:25.642275 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-3c561a64-ce66-4f30-aba4-f285657c7bdc tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407ad282edd74fb1adf62fb63306779c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db365a6a9f6041a7a8749fd1a1e3d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:25.650774 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-3c561a64-ce66-4f30-aba4-f285657c7bdc tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] 10.222.0.20 "GET /compute/v2.1/servers/267d974a-0a42-4e11-ada0-68e101c4a48f" status: 200 len: 1574 microversion: 2.1 time: 0.242144 Jul 30 05:04:25.654300 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 443/931] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:04:25 2022] GET /compute/v2.1/servers/267d974a-0a42-4e11-ada0-68e101c4a48f => generated 1574 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:04:25.679854 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-a8e3e28f-f5a8-4ccd-936f-72b0367a836a tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:04:25.679854 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-a8e3e28f-f5a8-4ccd-936f-72b0367a836a tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:04:25.682063 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a8e3e28f-f5a8-4ccd-936f-72b0367a836a tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:25.682633 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a8e3e28f-f5a8-4ccd-936f-72b0367a836a tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:25.683636 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a8e3e28f-f5a8-4ccd-936f-72b0367a836a tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:25.684914 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a8e3e28f-f5a8-4ccd-936f-72b0367a836a tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:25.843498 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-a8e3e28f-f5a8-4ccd-936f-72b0367a836a tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:25.856289 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-a8e3e28f-f5a8-4ccd-936f-72b0367a836a tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:25.857797 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-a8e3e28f-f5a8-4ccd-936f-72b0367a836a tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:25.859004 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-a8e3e28f-f5a8-4ccd-936f-72b0367a836a tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b" status: 200 len: 1740 microversion: 2.20 time: 0.191398 Jul 30 05:04:25.859546 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 489/932] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:04:25 2022] GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b => generated 1740 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 05:04:26.678192 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-e4d10f21-e113-4ebd-af79-6603d37af7ab tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:04:26.679934 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-e4d10f21-e113-4ebd-af79-6603d37af7ab tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] [instance: 267d974a-0a42-4e11-ada0-68e101c4a48f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:04:26.702494 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e4d10f21-e113-4ebd-af79-6603d37af7ab tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:26.702494 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e4d10f21-e113-4ebd-af79-6603d37af7ab tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:26.702494 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e4d10f21-e113-4ebd-af79-6603d37af7ab tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:26.702494 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e4d10f21-e113-4ebd-af79-6603d37af7ab tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:26.887424 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-8b9370e7-dbf7-4b8e-8369-b9a70484c077 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:04:26.888090 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-8b9370e7-dbf7-4b8e-8369-b9a70484c077 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:04:26.896002 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8b9370e7-dbf7-4b8e-8369-b9a70484c077 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:26.896672 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8b9370e7-dbf7-4b8e-8369-b9a70484c077 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:26.897812 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8b9370e7-dbf7-4b8e-8369-b9a70484c077 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:26.898415 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8b9370e7-dbf7-4b8e-8369-b9a70484c077 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:27.050743 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-e4d10f21-e113-4ebd-af79-6603d37af7ab tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407ad282edd74fb1adf62fb63306779c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db365a6a9f6041a7a8749fd1a1e3d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:27.060551 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-e4d10f21-e113-4ebd-af79-6603d37af7ab tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] 10.222.0.20 "GET /compute/v2.1/servers/267d974a-0a42-4e11-ada0-68e101c4a48f" status: 200 len: 1574 microversion: 2.1 time: 0.388078 Jul 30 05:04:27.060972 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 444/933] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:04:26 2022] GET /compute/v2.1/servers/267d974a-0a42-4e11-ada0-68e101c4a48f => generated 1574 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:04:27.123053 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-8b9370e7-dbf7-4b8e-8369-b9a70484c077 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:27.155063 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-8b9370e7-dbf7-4b8e-8369-b9a70484c077 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:27.156567 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-8b9370e7-dbf7-4b8e-8369-b9a70484c077 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:27.161605 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-8b9370e7-dbf7-4b8e-8369-b9a70484c077 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b" status: 200 len: 1740 microversion: 2.20 time: 0.278701 Jul 30 05:04:27.179310 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 490/934] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:04:26 2022] GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b => generated 1740 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 05:04:27.608568 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-033e1fb7-c2a6-4d0f-9b76-63358d55faf5 req-6079ba90-66d2-440b-8564-758b45adef61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "267d974a-0a42-4e11-ada0-68e101c4a48f", "name": "network-vif-deleted", "tag": "aa5879dd-2e84-4f75-818a-bc12a63594f3"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:04:27.625147 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-033e1fb7-c2a6-4d0f-9b76-63358d55faf5 req-6079ba90-66d2-440b-8564-758b45adef61 service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:27.625590 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-033e1fb7-c2a6-4d0f-9b76-63358d55faf5 req-6079ba90-66d2-440b-8564-758b45adef61 service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:27.660551 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-033e1fb7-c2a6-4d0f-9b76-63358d55faf5 req-6079ba90-66d2-440b-8564-758b45adef61 service nova] Creating event network-vif-deleted:aa5879dd-2e84-4f75-818a-bc12a63594f3 for instance 267d974a-0a42-4e11-ada0-68e101c4a48f on hv-cinder-85127 Jul 30 05:04:27.679436 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-033e1fb7-c2a6-4d0f-9b76-63358d55faf5 req-6079ba90-66d2-440b-8564-758b45adef61 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074498 Jul 30 05:04:27.681992 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 445/935] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Jul 30 05:04:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 05:04:28.086144 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-e075003d-556a-4988-8a98-2b667e632f68 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:04:28.087626 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-e075003d-556a-4988-8a98-2b667e632f68 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] [instance: 267d974a-0a42-4e11-ada0-68e101c4a48f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:04:28.096769 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e075003d-556a-4988-8a98-2b667e632f68 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:28.097374 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e075003d-556a-4988-8a98-2b667e632f68 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:28.098391 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e075003d-556a-4988-8a98-2b667e632f68 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:28.099172 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e075003d-556a-4988-8a98-2b667e632f68 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:28.139484 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e075003d-556a-4988-8a98-2b667e632f68 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:28.140086 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e075003d-556a-4988-8a98-2b667e632f68 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:28.140573 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.objects.instance [None req-e075003d-556a-4988-8a98-2b667e632f68 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lazy-loading 'fault' on Instance uuid 267d974a-0a42-4e11-ada0-68e101c4a48f {{(pid=117886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 05:04:28.192362 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-e075003d-556a-4988-8a98-2b667e632f68 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407ad282edd74fb1adf62fb63306779c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db365a6a9f6041a7a8749fd1a1e3d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:28.195627 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-6a5222ae-b714-4e4b-8a55-2ed7bf62282a tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:04:28.196675 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-6a5222ae-b714-4e4b-8a55-2ed7bf62282a tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:04:28.201749 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-e075003d-556a-4988-8a98-2b667e632f68 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] 10.222.0.20 "GET /compute/v2.1/servers/267d974a-0a42-4e11-ada0-68e101c4a48f" status: 200 len: 1228 microversion: 2.1 time: 0.120011 Jul 30 05:04:28.202396 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 491/936] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:04:28 2022] GET /compute/v2.1/servers/267d974a-0a42-4e11-ada0-68e101c4a48f => generated 1228 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:04:28.203629 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6a5222ae-b714-4e4b-8a55-2ed7bf62282a tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:28.204294 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6a5222ae-b714-4e4b-8a55-2ed7bf62282a tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:28.205569 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6a5222ae-b714-4e4b-8a55-2ed7bf62282a tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:28.206058 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6a5222ae-b714-4e4b-8a55-2ed7bf62282a tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:28.418003 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-6a5222ae-b714-4e4b-8a55-2ed7bf62282a tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:28.426807 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-6a5222ae-b714-4e4b-8a55-2ed7bf62282a tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:28.428306 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-6a5222ae-b714-4e4b-8a55-2ed7bf62282a tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:28.429455 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-6a5222ae-b714-4e4b-8a55-2ed7bf62282a tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b" status: 200 len: 1740 microversion: 2.20 time: 0.241489 Jul 30 05:04:28.430071 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 446/937] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:04:28 2022] GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b => generated 1740 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 05:04:29.223380 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-3fd4b975-07c4-4359-b528-48b5f76b8aea tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:04:29.223998 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-3fd4b975-07c4-4359-b528-48b5f76b8aea tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] [instance: 267d974a-0a42-4e11-ada0-68e101c4a48f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:04:29.230535 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3fd4b975-07c4-4359-b528-48b5f76b8aea tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:29.230993 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3fd4b975-07c4-4359-b528-48b5f76b8aea tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:29.231766 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3fd4b975-07c4-4359-b528-48b5f76b8aea tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:29.232233 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3fd4b975-07c4-4359-b528-48b5f76b8aea tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:29.246920 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.wsgi [None req-3fd4b975-07c4-4359-b528-48b5f76b8aea tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] HTTP exception thrown: Instance 267d974a-0a42-4e11-ada0-68e101c4a48f could not be found. Jul 30 05:04:29.248563 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-3fd4b975-07c4-4359-b528-48b5f76b8aea tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Request method failure captured: Jul 30 05:04:29.248563 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: request: GET /compute/v2.1/servers/267d974a-0a42-4e11-ada0-68e101c4a48f HTTP/1.1 Jul 30 05:04:29.248563 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Accept: application/json Jul 30 05:04:29.248563 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Accept-Encoding: identity Jul 30 05:04:29.248563 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Connection: close Jul 30 05:04:29.248563 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Content-Length: 0 Jul 30 05:04:29.248563 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Content-Type: application/json Jul 30 05:04:29.248563 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Host: 10.222.0.20 Jul 30 05:04:29.248563 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Openstack-System-Scope: None Jul 30 05:04:29.248563 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: User-Agent: python-urllib3/1.26.10 Jul 30 05:04:29.248563 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Auth-Token: gAAAAABi5LsFP9OEche5y4lXG8VwGjqGB-lqgOtZrs-5_9c2R6Ag-8NJaxcwTtiw3SgdSFybZr7J-RfHRufrRc3qDvPG20s46MHR8DjH4ANvKOo1Trrkozk2BziuELSDEtqCND7Enojbk0EIGZsF5tf92zb61OWPzHEQzgEVzNlSDTTbdyS26ok Jul 30 05:04:29.248563 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Domain-Id: None Jul 30 05:04:29.248563 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Domain-Name: None Jul 30 05:04:29.248563 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Identity-Status: Confirmed Jul 30 05:04:29.248563 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Is-Admin-Project: True Jul 30 05:04:29.248563 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Project-Domain-Id: default Jul 30 05:04:29.248563 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Project-Domain-Name: Default Jul 30 05:04:29.248563 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Project-Id: db365a6a9f6041a7a8749fd1a1e3d488 Jul 30 05:04:29.248563 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Project-Name: tempest-TestVolumeBootPattern-2000315609 Jul 30 05:04:29.248563 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Role: member,reader Jul 30 05:04:29.248563 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Roles: member,reader Jul 30 05:04:29.250276 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/db365a6a9f6041a7a8749fd1a1e3d488"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/db365a6a9f6041a7a8749fd1a1e3d488"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_db365a6a9f6041a7a8749fd1a1e3d488"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/db365a6a9f6041a7a8749fd1a1e3d488"}]}] Jul 30 05:04:29.250276 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Tenant: tempest-TestVolumeBootPattern-2000315609 Jul 30 05:04:29.250276 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Tenant-Id: db365a6a9f6041a7a8749fd1a1e3d488 Jul 30 05:04:29.250276 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Tenant-Name: tempest-TestVolumeBootPattern-2000315609 Jul 30 05:04:29.250276 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User: tempest-TestVolumeBootPattern-2000315609-project Jul 30 05:04:29.250276 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User-Domain-Id: default Jul 30 05:04:29.250276 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User-Domain-Name: Default Jul 30 05:04:29.250276 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User-Id: 407ad282edd74fb1adf62fb63306779c Jul 30 05:04:29.250276 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User-Name: tempest-TestVolumeBootPattern-2000315609-project Jul 30 05:04:29.250276 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: method: > Jul 30 05:04:29.250276 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: exception: Instance 267d974a-0a42-4e11-ada0-68e101c4a48f could not be found. Jul 30 05:04:29.250276 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: action_args: {'id': '267d974a-0a42-4e11-ada0-68e101c4a48f'} Jul 30 05:04:29.259565 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 05:04:29.259565 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:04:29.259565 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 05:04:29.259565 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 05:04:29.259565 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 05:04:29.259565 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 05:04:29.259565 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 05:04:29.259565 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 05:04:29.259565 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 05:04:29.259565 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 05:04:29.259565 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 267d974a-0a42-4e11-ada0-68e101c4a48f could not be found. Jul 30 05:04:29.259565 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 05:04:29.259565 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 05:04:29.259565 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 05:04:29.259565 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:04:29.259565 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 05:04:29.259565 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 05:04:29.259565 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 05:04:29.259565 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 05:04:29.259565 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 05:04:29.261104 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 05:04:29.261104 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 05:04:29.261104 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 05:04:29.261104 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 05:04:29.261104 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 05:04:29.261104 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 05:04:29.261104 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 05:04:29.261104 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 267d974a-0a42-4e11-ada0-68e101c4a48f could not be found. Jul 30 05:04:29.261104 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 05:04:29.261104 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 05:04:29.261104 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 05:04:29.261104 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:04:29.261104 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 05:04:29.261104 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 05:04:29.261104 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 05:04:29.261104 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 05:04:29.261104 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 267d974a-0a42-4e11-ada0-68e101c4a48f could not be found. Jul 30 05:04:29.261104 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 05:04:29.262380 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-3fd4b975-07c4-4359-b528-48b5f76b8aea tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Returning 404 to user: Instance 267d974a-0a42-4e11-ada0-68e101c4a48f could not be found. {{(pid=117886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 05:04:29.262380 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-3fd4b975-07c4-4359-b528-48b5f76b8aea tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] 10.222.0.20 "GET /compute/v2.1/servers/267d974a-0a42-4e11-ada0-68e101c4a48f" status: 404 len: 111 microversion: 2.1 time: 0.030448 Jul 30 05:04:29.262380 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 492/938] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:04:29 2022] GET /compute/v2.1/servers/267d974a-0a42-4e11-ada0-68e101c4a48f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 05:04:29.356322 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-38169d6a-0652-48f3-999e-42c0b2dca3e7 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1673998843", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-275234029", "security_groups": [{"name": "tempest-secgroup-smoke-9281366"}], "block_device_mapping_v2": [{"uuid": "76b2ac9a-b7e1-440d-a49d-22fa5f8c737c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "05de52c4-affb-4a9e-aea7-e8e105567377"}]}} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:04:29.453382 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-8ff0d0d8-25c7-4231-87d5-338bb77bcc3a tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:04:29.454243 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-8ff0d0d8-25c7-4231-87d5-338bb77bcc3a tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:04:29.461376 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8ff0d0d8-25c7-4231-87d5-338bb77bcc3a tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:29.462056 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8ff0d0d8-25c7-4231-87d5-338bb77bcc3a tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:29.463075 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8ff0d0d8-25c7-4231-87d5-338bb77bcc3a tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:29.463994 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8ff0d0d8-25c7-4231-87d5-338bb77bcc3a tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:29.508193 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.network.neutron [None req-38169d6a-0652-48f3-999e-42c0b2dca3e7 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] validate_networks() for [('05de52c4-affb-4a9e-aea7-e8e105567377', None, None, None, None, None)] {{(pid=117885) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 05:04:29.617879 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-8ff0d0d8-25c7-4231-87d5-338bb77bcc3a tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:29.626595 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-8ff0d0d8-25c7-4231-87d5-338bb77bcc3a tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:29.628379 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-8ff0d0d8-25c7-4231-87d5-338bb77bcc3a tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:29.629562 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-8ff0d0d8-25c7-4231-87d5-338bb77bcc3a tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b" status: 200 len: 1722 microversion: 2.20 time: 0.180285 Jul 30 05:04:29.630285 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 493/939] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:04:29 2022] GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b => generated 1722 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 05:04:30.007686 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-38169d6a-0652-48f3-999e-42c0b2dca3e7 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Flavor limits 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 05:04:30.010015 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-38169d6a-0652-48f3-999e-42c0b2dca3e7 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Image limits 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 05:04:30.010539 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-38169d6a-0652-48f3-999e-42c0b2dca3e7 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Flavor pref 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 05:04:30.010956 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-38169d6a-0652-48f3-999e-42c0b2dca3e7 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Image pref 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 05:04:30.011371 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-38169d6a-0652-48f3-999e-42c0b2dca3e7 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 05:04:30.020863 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-38169d6a-0652-48f3-999e-42c0b2dca3e7 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:30.021306 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-38169d6a-0652-48f3-999e-42c0b2dca3e7 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:30.022096 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-38169d6a-0652-48f3-999e-42c0b2dca3e7 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:30.022563 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-38169d6a-0652-48f3-999e-42c0b2dca3e7 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:30.038932 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.quota [None req-38169d6a-0652-48f3-999e-42c0b2dca3e7 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Getting quotas for project db365a6a9f6041a7a8749fd1a1e3d488. Resources: {'ram', 'cores', 'instances'} {{(pid=117885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 05:04:30.042787 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.quota [None req-38169d6a-0652-48f3-999e-42c0b2dca3e7 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Getting quotas for user 407ad282edd74fb1adf62fb63306779c and project db365a6a9f6041a7a8749fd1a1e3d488. Resources: {'ram', 'cores', 'instances'} {{(pid=117885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 05:04:30.100621 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-38169d6a-0652-48f3-999e-42c0b2dca3e7 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Going to run 1 instances... {{(pid=117885) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 05:04:30.102720 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-38169d6a-0652-48f3-999e-42c0b2dca3e7 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] [instance: 8520739a-9a63-4295-843a-b86a4aa10cab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='76b2ac9a-b7e1-440d-a49d-22fa5f8c737c',volume_size=None,volume_type=None)] {{(pid=117885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 05:04:30.228635 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-38169d6a-0652-48f3-999e-42c0b2dca3e7 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.876581 Jul 30 05:04:30.229275 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 447/940] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Jul 30 05:04:29 2022] POST /compute/v2.1/servers => generated 403 bytes in 878 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 05:04:30.240776 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-77dcaf22-e4d3-4652-a810-884adee32158 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:04:30.241401 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-77dcaf22-e4d3-4652-a810-884adee32158 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] [instance: 8520739a-9a63-4295-843a-b86a4aa10cab] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:04:30.301075 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-77dcaf22-e4d3-4652-a810-884adee32158 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407ad282edd74fb1adf62fb63306779c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db365a6a9f6041a7a8749fd1a1e3d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:30.307764 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-77dcaf22-e4d3-4652-a810-884adee32158 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] 10.222.0.20 "GET /compute/v2.1/servers/8520739a-9a63-4295-843a-b86a4aa10cab" status: 200 len: 1094 microversion: 2.1 time: 0.070969 Jul 30 05:04:30.308314 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 494/941] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:04:30 2022] GET /compute/v2.1/servers/8520739a-9a63-4295-843a-b86a4aa10cab => generated 1094 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:04:30.653840 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-451bc2ed-6ada-4909-88ee-8e1ab392df9c tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:04:30.654475 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-451bc2ed-6ada-4909-88ee-8e1ab392df9c tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:04:30.660760 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-451bc2ed-6ada-4909-88ee-8e1ab392df9c tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:30.661219 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-451bc2ed-6ada-4909-88ee-8e1ab392df9c tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:30.661986 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-451bc2ed-6ada-4909-88ee-8e1ab392df9c tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:30.662430 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-451bc2ed-6ada-4909-88ee-8e1ab392df9c tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:30.792456 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-451bc2ed-6ada-4909-88ee-8e1ab392df9c tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:30.802352 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-451bc2ed-6ada-4909-88ee-8e1ab392df9c tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:30.803847 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-451bc2ed-6ada-4909-88ee-8e1ab392df9c tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:30.805016 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-451bc2ed-6ada-4909-88ee-8e1ab392df9c tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b" status: 200 len: 1722 microversion: 2.20 time: 0.155717 Jul 30 05:04:30.817914 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 448/942] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:04:30 2022] GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 05:04:31.330178 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-2e8fdb73-9e06-44e9-b2e5-12146fc5121a tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:04:31.331801 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-2e8fdb73-9e06-44e9-b2e5-12146fc5121a tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] [instance: 8520739a-9a63-4295-843a-b86a4aa10cab] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:04:31.339558 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2e8fdb73-9e06-44e9-b2e5-12146fc5121a tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:31.340264 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2e8fdb73-9e06-44e9-b2e5-12146fc5121a tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:31.341237 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2e8fdb73-9e06-44e9-b2e5-12146fc5121a tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:31.341866 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2e8fdb73-9e06-44e9-b2e5-12146fc5121a tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:31.418402 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-2e8fdb73-9e06-44e9-b2e5-12146fc5121a tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407ad282edd74fb1adf62fb63306779c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db365a6a9f6041a7a8749fd1a1e3d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:31.428326 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-2e8fdb73-9e06-44e9-b2e5-12146fc5121a tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] 10.222.0.20 "GET /compute/v2.1/servers/8520739a-9a63-4295-843a-b86a4aa10cab" status: 200 len: 1136 microversion: 2.1 time: 0.103670 Jul 30 05:04:31.429705 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 495/943] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:04:31 2022] GET /compute/v2.1/servers/8520739a-9a63-4295-843a-b86a4aa10cab => generated 1136 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:04:31.828187 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-549c353f-2134-4a93-ab0a-61aefb0eb2f4 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:04:31.828812 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-549c353f-2134-4a93-ab0a-61aefb0eb2f4 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:04:31.835580 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-549c353f-2134-4a93-ab0a-61aefb0eb2f4 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:31.836036 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-549c353f-2134-4a93-ab0a-61aefb0eb2f4 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:31.836801 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-549c353f-2134-4a93-ab0a-61aefb0eb2f4 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:31.837232 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-549c353f-2134-4a93-ab0a-61aefb0eb2f4 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:32.050655 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-549c353f-2134-4a93-ab0a-61aefb0eb2f4 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:32.068864 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-549c353f-2134-4a93-ab0a-61aefb0eb2f4 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:32.070609 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-549c353f-2134-4a93-ab0a-61aefb0eb2f4 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:32.072127 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-549c353f-2134-4a93-ab0a-61aefb0eb2f4 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b" status: 200 len: 1725 microversion: 2.20 time: 0.247766 Jul 30 05:04:32.072747 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 449/944] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:04:31 2022] GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b => generated 1725 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 05:04:32.099641 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-c9eef7cf-4e1e-45eb-b418-811580468fad tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "15e5d511-2edc-462b-b448-17605221daa0"}} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:04:32.103253 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-c9eef7cf-4e1e-45eb-b418-811580468fad tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:04:32.113427 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c9eef7cf-4e1e-45eb-b418-811580468fad tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:32.113921 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c9eef7cf-4e1e-45eb-b418-811580468fad tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:32.114982 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c9eef7cf-4e1e-45eb-b418-811580468fad tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:32.115578 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c9eef7cf-4e1e-45eb-b418-811580468fad tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:32.371353 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:04:32.451774 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-23579ac4-36d3-478e-a3fd-bb8fc0b0ca1c tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:04:32.452529 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-23579ac4-36d3-478e-a3fd-bb8fc0b0ca1c tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] [instance: 8520739a-9a63-4295-843a-b86a4aa10cab] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:04:32.461535 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-23579ac4-36d3-478e-a3fd-bb8fc0b0ca1c tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:32.462498 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-23579ac4-36d3-478e-a3fd-bb8fc0b0ca1c tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:32.463705 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-23579ac4-36d3-478e-a3fd-bb8fc0b0ca1c tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:32.464767 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-23579ac4-36d3-478e-a3fd-bb8fc0b0ca1c tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:32.486255 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-c9eef7cf-4e1e-45eb-b418-811580468fad tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "POST /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.393704 Jul 30 05:04:32.488927 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 496/945] 10.222.0.20 () {62 vars in 1364 bytes} [Sat Jul 30 05:04:32 2022] POST /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b/os-volume_attachments => generated 188 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 30 05:04:32.585086 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-23579ac4-36d3-478e-a3fd-bb8fc0b0ca1c tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407ad282edd74fb1adf62fb63306779c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db365a6a9f6041a7a8749fd1a1e3d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:32.594452 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-23579ac4-36d3-478e-a3fd-bb8fc0b0ca1c tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] 10.222.0.20 "GET /compute/v2.1/servers/8520739a-9a63-4295-843a-b86a4aa10cab" status: 200 len: 1210 microversion: 2.1 time: 0.146996 Jul 30 05:04:32.596214 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 450/946] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:04:32 2022] GET /compute/v2.1/servers/8520739a-9a63-4295-843a-b86a4aa10cab => generated 1210 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:04:32.669167 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-88c8df8f-c024-4a57-bd73-93f23461a9cd tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:04:32.670537 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-88c8df8f-c024-4a57-bd73-93f23461a9cd tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:04:32.679227 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-88c8df8f-c024-4a57-bd73-93f23461a9cd tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:32.679726 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-88c8df8f-c024-4a57-bd73-93f23461a9cd tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:32.680709 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-88c8df8f-c024-4a57-bd73-93f23461a9cd tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:32.681303 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-88c8df8f-c024-4a57-bd73-93f23461a9cd tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:33.037890 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-88c8df8f-c024-4a57-bd73-93f23461a9cd tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b/os-volume_attachments/15e5d511-2edc-462b-b448-17605221daa0" status: 202 len: 0 microversion: 2.20 time: 0.372350 Jul 30 05:04:33.039138 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 497/947] 10.222.0.20 () {60 vars in 1457 bytes} [Sat Jul 30 05:04:32 2022] DELETE /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b/os-volume_attachments/15e5d511-2edc-462b-b448-17605221daa0 => generated 0 bytes in 375 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 30 05:04:33.113613 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-32da6da8-1305-40bf-8337-ac8d697e3506 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:04:33.114789 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-32da6da8-1305-40bf-8337-ac8d697e3506 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:04:33.121762 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-32da6da8-1305-40bf-8337-ac8d697e3506 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:33.122218 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-32da6da8-1305-40bf-8337-ac8d697e3506 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:33.123042 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-32da6da8-1305-40bf-8337-ac8d697e3506 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:33.123493 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-32da6da8-1305-40bf-8337-ac8d697e3506 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:33.159211 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-32da6da8-1305-40bf-8337-ac8d697e3506 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=117885) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Jul 30 05:04:33.248146 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:04:33.273828 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-32da6da8-1305-40bf-8337-ac8d697e3506 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "POST /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b/action" status: 202 len: 0 microversion: 2.20 time: 0.167269 Jul 30 05:04:33.275087 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 451/948] 10.222.0.20 () {62 vars in 1319 bytes} [Sat Jul 30 05:04:33 2022] POST /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b/action => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 30 05:04:33.286991 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-bc71d07b-9a1b-4642-9f59-680f3c7d66b6 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:04:33.289180 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-bc71d07b-9a1b-4642-9f59-680f3c7d66b6 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:04:33.310165 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bc71d07b-9a1b-4642-9f59-680f3c7d66b6 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:33.316990 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bc71d07b-9a1b-4642-9f59-680f3c7d66b6 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:33.319282 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bc71d07b-9a1b-4642-9f59-680f3c7d66b6 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:33.324669 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bc71d07b-9a1b-4642-9f59-680f3c7d66b6 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:33.414589 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-5909c39b-39d4-433e-983c-6c8ca261b9ac req-c91b3193-7ec6-4930-94e0-203a55168ae8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b", "name": "network-vif-unplugged", "status": "completed", "tag": "6ca5af71-3aff-4af4-9271-ac47c637cc34"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:04:33.430059 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-5909c39b-39d4-433e-983c-6c8ca261b9ac req-c91b3193-7ec6-4930-94e0-203a55168ae8 service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:33.431057 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-5909c39b-39d4-433e-983c-6c8ca261b9ac req-c91b3193-7ec6-4930-94e0-203a55168ae8 service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:33.472996 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.compute.server_external_events [req-5909c39b-39d4-433e-983c-6c8ca261b9ac req-c91b3193-7ec6-4930-94e0-203a55168ae8 service nova] Unable to find a host for instance b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b. Dropping event network-vif-unplugged {{(pid=117885) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 30 05:04:33.474095 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-5909c39b-39d4-433e-983c-6c8ca261b9ac req-c91b3193-7ec6-4930-94e0-203a55168ae8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.072548 Jul 30 05:04:33.475357 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 452/949] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Jul 30 05:04:33 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 74 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jul 30 05:04:33.604534 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-bc71d07b-9a1b-4642-9f59-680f3c7d66b6 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:33.613912 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-bc71d07b-9a1b-4642-9f59-680f3c7d66b6 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:33.616621 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-149a71d8-e354-4501-9c01-a71c944a145b tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:04:33.617246 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-149a71d8-e354-4501-9c01-a71c944a145b tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] [instance: 8520739a-9a63-4295-843a-b86a4aa10cab] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:04:33.619389 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-bc71d07b-9a1b-4642-9f59-680f3c7d66b6 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:33.622235 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-bc71d07b-9a1b-4642-9f59-680f3c7d66b6 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b" status: 200 len: 1673 microversion: 2.20 time: 0.343089 Jul 30 05:04:33.623739 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 498/950] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:04:33 2022] GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b => generated 1673 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 05:04:33.627683 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-149a71d8-e354-4501-9c01-a71c944a145b tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:33.628144 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-149a71d8-e354-4501-9c01-a71c944a145b tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:33.628935 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-149a71d8-e354-4501-9c01-a71c944a145b tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:33.629378 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-149a71d8-e354-4501-9c01-a71c944a145b tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:33.902068 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-149a71d8-e354-4501-9c01-a71c944a145b tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407ad282edd74fb1adf62fb63306779c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db365a6a9f6041a7a8749fd1a1e3d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:33.912441 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-149a71d8-e354-4501-9c01-a71c944a145b tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] 10.222.0.20 "GET /compute/v2.1/servers/8520739a-9a63-4295-843a-b86a4aa10cab" status: 200 len: 1263 microversion: 2.1 time: 0.299515 Jul 30 05:04:33.913669 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 453/951] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:04:33 2022] GET /compute/v2.1/servers/8520739a-9a63-4295-843a-b86a4aa10cab => generated 1263 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 05:04:34.228615 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-2c70ce45-55c2-4a90-af5a-376e6a817506 req-dd1cea94-5e02-45df-91bd-d7ed378d0da1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8520739a-9a63-4295-843a-b86a4aa10cab", "tag": "2044be95-863c-488f-8fdd-ec89733220ef"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:04:34.246740 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-2c70ce45-55c2-4a90-af5a-376e6a817506 req-dd1cea94-5e02-45df-91bd-d7ed378d0da1 service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:34.247298 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-2c70ce45-55c2-4a90-af5a-376e6a817506 req-dd1cea94-5e02-45df-91bd-d7ed378d0da1 service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:34.265993 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-2c70ce45-55c2-4a90-af5a-376e6a817506 req-dd1cea94-5e02-45df-91bd-d7ed378d0da1 service nova] Creating event network-changed:2044be95-863c-488f-8fdd-ec89733220ef for instance 8520739a-9a63-4295-843a-b86a4aa10cab on hv-cinder-85127 Jul 30 05:04:34.274584 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-2c70ce45-55c2-4a90-af5a-376e6a817506 req-dd1cea94-5e02-45df-91bd-d7ed378d0da1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049530 Jul 30 05:04:34.275673 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 499/952] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Jul 30 05:04:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 05:04:34.651478 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-18a3f07b-4a44-4f5d-89d0-42432faeb1c7 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:04:34.652120 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-18a3f07b-4a44-4f5d-89d0-42432faeb1c7 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:04:34.659388 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-18a3f07b-4a44-4f5d-89d0-42432faeb1c7 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:34.659838 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-18a3f07b-4a44-4f5d-89d0-42432faeb1c7 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:34.660606 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-18a3f07b-4a44-4f5d-89d0-42432faeb1c7 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:34.661039 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-18a3f07b-4a44-4f5d-89d0-42432faeb1c7 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:34.796118 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-18a3f07b-4a44-4f5d-89d0-42432faeb1c7 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:34.804565 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-18a3f07b-4a44-4f5d-89d0-42432faeb1c7 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:34.805993 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-18a3f07b-4a44-4f5d-89d0-42432faeb1c7 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:34.807186 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-18a3f07b-4a44-4f5d-89d0-42432faeb1c7 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b" status: 200 len: 1731 microversion: 2.20 time: 0.159567 Jul 30 05:04:34.807739 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 454/953] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:04:34 2022] GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b => generated 1731 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 05:04:34.936758 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-40a5c0ec-5701-4bf2-833a-6fe0f3394d35 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:04:34.937565 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-40a5c0ec-5701-4bf2-833a-6fe0f3394d35 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] [instance: 8520739a-9a63-4295-843a-b86a4aa10cab] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:04:34.944587 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-40a5c0ec-5701-4bf2-833a-6fe0f3394d35 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:34.945131 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-40a5c0ec-5701-4bf2-833a-6fe0f3394d35 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:34.945981 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-40a5c0ec-5701-4bf2-833a-6fe0f3394d35 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:34.946665 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-40a5c0ec-5701-4bf2-833a-6fe0f3394d35 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:35.169722 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-40a5c0ec-5701-4bf2-833a-6fe0f3394d35 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407ad282edd74fb1adf62fb63306779c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db365a6a9f6041a7a8749fd1a1e3d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:35.198493 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-40a5c0ec-5701-4bf2-833a-6fe0f3394d35 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] 10.222.0.20 "GET /compute/v2.1/servers/8520739a-9a63-4295-843a-b86a4aa10cab" status: 200 len: 1263 microversion: 2.1 time: 0.266815 Jul 30 05:04:35.210515 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 500/954] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:04:34 2022] GET /compute/v2.1/servers/8520739a-9a63-4295-843a-b86a4aa10cab => generated 1263 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:04:35.832153 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-f2d05aea-c99c-4dc3-8ed4-933018da794a tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:04:35.832789 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-f2d05aea-c99c-4dc3-8ed4-933018da794a tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:04:35.839458 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f2d05aea-c99c-4dc3-8ed4-933018da794a tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:35.839901 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f2d05aea-c99c-4dc3-8ed4-933018da794a tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:35.840908 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f2d05aea-c99c-4dc3-8ed4-933018da794a tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:35.841348 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f2d05aea-c99c-4dc3-8ed4-933018da794a tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:36.181663 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-f2d05aea-c99c-4dc3-8ed4-933018da794a tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:36.191119 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-f2d05aea-c99c-4dc3-8ed4-933018da794a tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:36.193041 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-f2d05aea-c99c-4dc3-8ed4-933018da794a tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:36.194344 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-f2d05aea-c99c-4dc3-8ed4-933018da794a tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b" status: 200 len: 1731 microversion: 2.20 time: 0.366847 Jul 30 05:04:36.195123 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 455/955] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:04:35 2022] GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b => generated 1731 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 05:04:36.226615 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-8c82172f-5039-4eaa-a91f-1eaac9352b5f tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:04:36.227240 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-8c82172f-5039-4eaa-a91f-1eaac9352b5f tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] [instance: 8520739a-9a63-4295-843a-b86a4aa10cab] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:04:36.235593 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8c82172f-5039-4eaa-a91f-1eaac9352b5f tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:36.236223 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8c82172f-5039-4eaa-a91f-1eaac9352b5f tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:36.237854 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8c82172f-5039-4eaa-a91f-1eaac9352b5f tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:36.238313 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-8c82172f-5039-4eaa-a91f-1eaac9352b5f tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:36.415693 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-8c82172f-5039-4eaa-a91f-1eaac9352b5f tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407ad282edd74fb1adf62fb63306779c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db365a6a9f6041a7a8749fd1a1e3d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:36.428278 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-8c82172f-5039-4eaa-a91f-1eaac9352b5f tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] 10.222.0.20 "GET /compute/v2.1/servers/8520739a-9a63-4295-843a-b86a4aa10cab" status: 200 len: 1263 microversion: 2.1 time: 0.206606 Jul 30 05:04:36.429309 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 501/956] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:04:36 2022] GET /compute/v2.1/servers/8520739a-9a63-4295-843a-b86a4aa10cab => generated 1263 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:04:37.218260 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-d02d6f75-dcc1-46f1-b2f9-bfd3243b48ff tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:04:37.218902 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-d02d6f75-dcc1-46f1-b2f9-bfd3243b48ff tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:04:37.225906 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d02d6f75-dcc1-46f1-b2f9-bfd3243b48ff tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:37.226359 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d02d6f75-dcc1-46f1-b2f9-bfd3243b48ff tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:37.227172 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d02d6f75-dcc1-46f1-b2f9-bfd3243b48ff tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:37.227614 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d02d6f75-dcc1-46f1-b2f9-bfd3243b48ff tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:37.368676 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-d02d6f75-dcc1-46f1-b2f9-bfd3243b48ff tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:37.377696 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-d02d6f75-dcc1-46f1-b2f9-bfd3243b48ff tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:37.379260 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-d02d6f75-dcc1-46f1-b2f9-bfd3243b48ff tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:37.381211 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-d02d6f75-dcc1-46f1-b2f9-bfd3243b48ff tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b" status: 200 len: 1731 microversion: 2.20 time: 0.166078 Jul 30 05:04:37.381211 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 456/957] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:04:37 2022] GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 05:04:37.450912 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-94cf85d8-4ecf-4e03-8997-8f3f4adf82ba tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:04:37.451527 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-94cf85d8-4ecf-4e03-8997-8f3f4adf82ba tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] [instance: 8520739a-9a63-4295-843a-b86a4aa10cab] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:04:37.459499 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-94cf85d8-4ecf-4e03-8997-8f3f4adf82ba tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:37.459957 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-94cf85d8-4ecf-4e03-8997-8f3f4adf82ba tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:37.460787 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-94cf85d8-4ecf-4e03-8997-8f3f4adf82ba tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:37.461414 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-94cf85d8-4ecf-4e03-8997-8f3f4adf82ba tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:37.649503 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-94cf85d8-4ecf-4e03-8997-8f3f4adf82ba tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407ad282edd74fb1adf62fb63306779c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db365a6a9f6041a7a8749fd1a1e3d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:37.659154 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-94cf85d8-4ecf-4e03-8997-8f3f4adf82ba tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] 10.222.0.20 "GET /compute/v2.1/servers/8520739a-9a63-4295-843a-b86a4aa10cab" status: 200 len: 1263 microversion: 2.1 time: 0.212037 Jul 30 05:04:37.660950 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 502/958] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:04:37 2022] GET /compute/v2.1/servers/8520739a-9a63-4295-843a-b86a4aa10cab => generated 1263 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:04:38.405251 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-aa5e98d0-7e5d-4f57-afa8-d41359c421b8 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:04:38.405918 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-aa5e98d0-7e5d-4f57-afa8-d41359c421b8 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:04:38.413971 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-aa5e98d0-7e5d-4f57-afa8-d41359c421b8 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:38.414455 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-aa5e98d0-7e5d-4f57-afa8-d41359c421b8 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:38.415233 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-aa5e98d0-7e5d-4f57-afa8-d41359c421b8 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:38.415677 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-aa5e98d0-7e5d-4f57-afa8-d41359c421b8 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:38.614903 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-aa5e98d0-7e5d-4f57-afa8-d41359c421b8 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:38.643051 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-aa5e98d0-7e5d-4f57-afa8-d41359c421b8 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:38.645509 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-aa5e98d0-7e5d-4f57-afa8-d41359c421b8 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:38.651613 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-aa5e98d0-7e5d-4f57-afa8-d41359c421b8 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b" status: 200 len: 1731 microversion: 2.20 time: 0.250260 Jul 30 05:04:38.671328 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 457/959] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:04:38 2022] GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b => generated 1731 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 05:04:38.682918 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-de26c1cf-4e92-4db3-9757-a3a809c43e5a tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:04:38.684196 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-de26c1cf-4e92-4db3-9757-a3a809c43e5a tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] [instance: 8520739a-9a63-4295-843a-b86a4aa10cab] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:04:38.692636 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-de26c1cf-4e92-4db3-9757-a3a809c43e5a tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:38.693348 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-de26c1cf-4e92-4db3-9757-a3a809c43e5a tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:38.694264 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-de26c1cf-4e92-4db3-9757-a3a809c43e5a tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:38.705684 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-de26c1cf-4e92-4db3-9757-a3a809c43e5a tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:38.887355 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-de26c1cf-4e92-4db3-9757-a3a809c43e5a tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407ad282edd74fb1adf62fb63306779c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db365a6a9f6041a7a8749fd1a1e3d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:38.896242 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-de26c1cf-4e92-4db3-9757-a3a809c43e5a tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] 10.222.0.20 "GET /compute/v2.1/servers/8520739a-9a63-4295-843a-b86a4aa10cab" status: 200 len: 1263 microversion: 2.1 time: 0.217303 Jul 30 05:04:38.896973 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 503/960] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:04:38 2022] GET /compute/v2.1/servers/8520739a-9a63-4295-843a-b86a4aa10cab => generated 1263 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:04:39.684605 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-4c97cf6f-d178-40da-b8e1-89b1afff6dc7 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:04:39.685229 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-4c97cf6f-d178-40da-b8e1-89b1afff6dc7 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:04:39.691878 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4c97cf6f-d178-40da-b8e1-89b1afff6dc7 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:39.692333 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4c97cf6f-d178-40da-b8e1-89b1afff6dc7 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:39.693100 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4c97cf6f-d178-40da-b8e1-89b1afff6dc7 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:39.698491 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4c97cf6f-d178-40da-b8e1-89b1afff6dc7 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:39.844811 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-4c97cf6f-d178-40da-b8e1-89b1afff6dc7 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:39.854405 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-4c97cf6f-d178-40da-b8e1-89b1afff6dc7 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:39.855950 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-4c97cf6f-d178-40da-b8e1-89b1afff6dc7 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:39.857136 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-4c97cf6f-d178-40da-b8e1-89b1afff6dc7 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b" status: 200 len: 1731 microversion: 2.20 time: 0.176552 Jul 30 05:04:39.857699 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 458/961] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:04:39 2022] GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b => generated 1731 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 05:04:39.917334 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-49b1b163-62af-4585-b54f-177114ff3b0f tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:04:39.917955 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-49b1b163-62af-4585-b54f-177114ff3b0f tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] [instance: 8520739a-9a63-4295-843a-b86a4aa10cab] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:04:39.924758 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-49b1b163-62af-4585-b54f-177114ff3b0f tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:39.925208 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-49b1b163-62af-4585-b54f-177114ff3b0f tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:39.925975 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-49b1b163-62af-4585-b54f-177114ff3b0f tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:39.926417 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-49b1b163-62af-4585-b54f-177114ff3b0f tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:40.081668 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-49b1b163-62af-4585-b54f-177114ff3b0f tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407ad282edd74fb1adf62fb63306779c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db365a6a9f6041a7a8749fd1a1e3d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:40.089168 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-49b1b163-62af-4585-b54f-177114ff3b0f tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] 10.222.0.20 "GET /compute/v2.1/servers/8520739a-9a63-4295-843a-b86a4aa10cab" status: 200 len: 1263 microversion: 2.1 time: 0.175710 Jul 30 05:04:40.089738 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 504/962] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:04:39 2022] GET /compute/v2.1/servers/8520739a-9a63-4295-843a-b86a4aa10cab => generated 1263 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:04:40.881188 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-7f10df9b-8f5f-4c83-9ef2-10b770a192fa tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:04:40.881797 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-7f10df9b-8f5f-4c83-9ef2-10b770a192fa tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:04:40.883706 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell0:SELECT=2 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:04:40.884362 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell0:SELECT=6 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:04:40.890672 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7f10df9b-8f5f-4c83-9ef2-10b770a192fa tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:40.891636 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7f10df9b-8f5f-4c83-9ef2-10b770a192fa tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:40.892393 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7f10df9b-8f5f-4c83-9ef2-10b770a192fa tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:40.892825 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7f10df9b-8f5f-4c83-9ef2-10b770a192fa tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:41.039790 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-7f10df9b-8f5f-4c83-9ef2-10b770a192fa tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:41.049044 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-7f10df9b-8f5f-4c83-9ef2-10b770a192fa tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:41.050580 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-7f10df9b-8f5f-4c83-9ef2-10b770a192fa tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:41.051766 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-7f10df9b-8f5f-4c83-9ef2-10b770a192fa tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b" status: 200 len: 1731 microversion: 2.20 time: 0.174985 Jul 30 05:04:41.052323 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 459/963] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:04:40 2022] GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b => generated 1731 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 05:04:41.109281 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-29c0327a-d12e-4008-a0a2-1df17c057b22 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:04:41.109964 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-29c0327a-d12e-4008-a0a2-1df17c057b22 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] [instance: 8520739a-9a63-4295-843a-b86a4aa10cab] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:04:41.112180 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell0:SELECT=2 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:04:41.118590 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-29c0327a-d12e-4008-a0a2-1df17c057b22 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:41.119040 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-29c0327a-d12e-4008-a0a2-1df17c057b22 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:41.119822 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-29c0327a-d12e-4008-a0a2-1df17c057b22 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:41.120260 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-29c0327a-d12e-4008-a0a2-1df17c057b22 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:41.273497 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-29c0327a-d12e-4008-a0a2-1df17c057b22 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407ad282edd74fb1adf62fb63306779c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db365a6a9f6041a7a8749fd1a1e3d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:41.281287 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-29c0327a-d12e-4008-a0a2-1df17c057b22 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] 10.222.0.20 "GET /compute/v2.1/servers/8520739a-9a63-4295-843a-b86a4aa10cab" status: 200 len: 1263 microversion: 2.1 time: 0.175882 Jul 30 05:04:41.282933 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 505/964] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:04:41 2022] GET /compute/v2.1/servers/8520739a-9a63-4295-843a-b86a4aa10cab => generated 1263 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:04:42.076267 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-1b9405f5-b7b5-4270-9726-25000d588784 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:04:42.076876 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-1b9405f5-b7b5-4270-9726-25000d588784 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:04:42.083904 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1b9405f5-b7b5-4270-9726-25000d588784 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:42.084350 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1b9405f5-b7b5-4270-9726-25000d588784 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:42.085106 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1b9405f5-b7b5-4270-9726-25000d588784 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:42.085547 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1b9405f5-b7b5-4270-9726-25000d588784 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:42.223096 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-1b9405f5-b7b5-4270-9726-25000d588784 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:42.233795 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-1b9405f5-b7b5-4270-9726-25000d588784 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:42.236123 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-1b9405f5-b7b5-4270-9726-25000d588784 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:42.237559 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-1b9405f5-b7b5-4270-9726-25000d588784 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b" status: 200 len: 1731 microversion: 2.20 time: 0.165273 Jul 30 05:04:42.238133 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 460/965] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:04:42 2022] GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b => generated 1731 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 05:04:42.304739 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-25e4dae5-ac7a-41c0-b344-2e8d95a3c9f5 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:04:42.306168 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-25e4dae5-ac7a-41c0-b344-2e8d95a3c9f5 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] [instance: 8520739a-9a63-4295-843a-b86a4aa10cab] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:04:42.313903 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-25e4dae5-ac7a-41c0-b344-2e8d95a3c9f5 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:42.314373 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-25e4dae5-ac7a-41c0-b344-2e8d95a3c9f5 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:42.315214 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-25e4dae5-ac7a-41c0-b344-2e8d95a3c9f5 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:42.315648 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-25e4dae5-ac7a-41c0-b344-2e8d95a3c9f5 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:42.459505 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-25e4dae5-ac7a-41c0-b344-2e8d95a3c9f5 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407ad282edd74fb1adf62fb63306779c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db365a6a9f6041a7a8749fd1a1e3d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:42.467649 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-25e4dae5-ac7a-41c0-b344-2e8d95a3c9f5 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] 10.222.0.20 "GET /compute/v2.1/servers/8520739a-9a63-4295-843a-b86a4aa10cab" status: 200 len: 1263 microversion: 2.1 time: 0.167620 Jul 30 05:04:42.468711 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 506/966] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:04:42 2022] GET /compute/v2.1/servers/8520739a-9a63-4295-843a-b86a4aa10cab => generated 1263 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:04:43.263722 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-0fabc480-b603-4b74-8660-997e6db3fb15 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:04:43.264446 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-0fabc480-b603-4b74-8660-997e6db3fb15 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:04:43.274186 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0fabc480-b603-4b74-8660-997e6db3fb15 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:43.274790 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0fabc480-b603-4b74-8660-997e6db3fb15 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:43.275690 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0fabc480-b603-4b74-8660-997e6db3fb15 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:43.276144 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0fabc480-b603-4b74-8660-997e6db3fb15 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:43.440495 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-0fabc480-b603-4b74-8660-997e6db3fb15 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:43.449690 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-0fabc480-b603-4b74-8660-997e6db3fb15 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:43.451320 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-0fabc480-b603-4b74-8660-997e6db3fb15 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:43.452512 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-0fabc480-b603-4b74-8660-997e6db3fb15 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b" status: 200 len: 1731 microversion: 2.20 time: 0.195376 Jul 30 05:04:43.453102 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 461/967] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:04:43 2022] GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b => generated 1731 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 05:04:43.490009 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-4c62bbfb-64c5-4814-9ce5-141abfc15563 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:04:43.490758 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-4c62bbfb-64c5-4814-9ce5-141abfc15563 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] [instance: 8520739a-9a63-4295-843a-b86a4aa10cab] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:04:43.493299 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:04:43.498959 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4c62bbfb-64c5-4814-9ce5-141abfc15563 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:43.499415 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4c62bbfb-64c5-4814-9ce5-141abfc15563 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:43.500198 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4c62bbfb-64c5-4814-9ce5-141abfc15563 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:43.501914 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4c62bbfb-64c5-4814-9ce5-141abfc15563 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:43.648724 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-4c62bbfb-64c5-4814-9ce5-141abfc15563 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407ad282edd74fb1adf62fb63306779c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db365a6a9f6041a7a8749fd1a1e3d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:43.657893 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-4c62bbfb-64c5-4814-9ce5-141abfc15563 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] 10.222.0.20 "GET /compute/v2.1/servers/8520739a-9a63-4295-843a-b86a4aa10cab" status: 200 len: 1263 microversion: 2.1 time: 0.171650 Jul 30 05:04:43.658942 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 507/968] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:04:43 2022] GET /compute/v2.1/servers/8520739a-9a63-4295-843a-b86a4aa10cab => generated 1263 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:04:44.476153 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-ac61c42a-67e6-4968-9fb8-1bb83ea7126d tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:04:44.476750 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-ac61c42a-67e6-4968-9fb8-1bb83ea7126d tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:04:44.483411 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ac61c42a-67e6-4968-9fb8-1bb83ea7126d tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:44.483868 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ac61c42a-67e6-4968-9fb8-1bb83ea7126d tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:44.484658 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ac61c42a-67e6-4968-9fb8-1bb83ea7126d tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:44.485096 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ac61c42a-67e6-4968-9fb8-1bb83ea7126d tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:44.617068 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-ac61c42a-67e6-4968-9fb8-1bb83ea7126d tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:44.625111 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-ac61c42a-67e6-4968-9fb8-1bb83ea7126d tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:44.627442 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-ac61c42a-67e6-4968-9fb8-1bb83ea7126d tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:44.628616 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-ac61c42a-67e6-4968-9fb8-1bb83ea7126d tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b" status: 200 len: 1731 microversion: 2.20 time: 0.156366 Jul 30 05:04:44.629171 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 462/969] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:04:44 2022] GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 05:04:44.679815 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-50bf528f-9966-4d16-a4f0-8450d7998328 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:04:44.680563 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-50bf528f-9966-4d16-a4f0-8450d7998328 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] [instance: 8520739a-9a63-4295-843a-b86a4aa10cab] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:04:44.687141 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-50bf528f-9966-4d16-a4f0-8450d7998328 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:44.687590 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-50bf528f-9966-4d16-a4f0-8450d7998328 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:44.688997 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-50bf528f-9966-4d16-a4f0-8450d7998328 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:44.689435 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-50bf528f-9966-4d16-a4f0-8450d7998328 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:44.835131 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-50bf528f-9966-4d16-a4f0-8450d7998328 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407ad282edd74fb1adf62fb63306779c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db365a6a9f6041a7a8749fd1a1e3d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:44.842901 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-50bf528f-9966-4d16-a4f0-8450d7998328 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] 10.222.0.20 "GET /compute/v2.1/servers/8520739a-9a63-4295-843a-b86a4aa10cab" status: 200 len: 1263 microversion: 2.1 time: 0.167079 Jul 30 05:04:44.843944 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 508/970] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:04:44 2022] GET /compute/v2.1/servers/8520739a-9a63-4295-843a-b86a4aa10cab => generated 1263 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:04:45.652520 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-61977cc6-4871-4d0c-9c4e-093833ade133 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:04:45.653313 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-61977cc6-4871-4d0c-9c4e-093833ade133 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:04:45.665658 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-6768c49a-bca2-4ba4-97bc-8177394b00c0 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:04:45.667891 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-6768c49a-bca2-4ba4-97bc-8177394b00c0 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] [instance: 0faad1c9-0b0d-44af-92cb-dd0acd61c755] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:04:45.671676 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-61977cc6-4871-4d0c-9c4e-093833ade133 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:45.672972 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-61977cc6-4871-4d0c-9c4e-093833ade133 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:45.675936 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-61977cc6-4871-4d0c-9c4e-093833ade133 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:45.676857 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-61977cc6-4871-4d0c-9c4e-093833ade133 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:45.678552 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6768c49a-bca2-4ba4-97bc-8177394b00c0 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:45.680923 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6768c49a-bca2-4ba4-97bc-8177394b00c0 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:45.682393 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6768c49a-bca2-4ba4-97bc-8177394b00c0 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:45.685844 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6768c49a-bca2-4ba4-97bc-8177394b00c0 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:45.743081 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:INSERT=4,nova_cell1:SELECT=89,nova_cell1:UPDATE=7 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:04:45.780536 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-6768c49a-bca2-4ba4-97bc-8177394b00c0 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] 10.222.0.20 "POST /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755/action" status: 202 len: 0 microversion: 2.1 time: 0.118630 Jul 30 05:04:45.782057 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 509/971] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Jul 30 05:04:45 2022] POST /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 30 05:04:45.790674 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-c05da785-f883-4e58-bb53-b1763b114296 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:04:45.791624 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-c05da785-f883-4e58-bb53-b1763b114296 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] [instance: 0faad1c9-0b0d-44af-92cb-dd0acd61c755] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:04:45.800003 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c05da785-f883-4e58-bb53-b1763b114296 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:45.800448 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c05da785-f883-4e58-bb53-b1763b114296 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:45.801222 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c05da785-f883-4e58-bb53-b1763b114296 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:45.801691 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c05da785-f883-4e58-bb53-b1763b114296 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:45.903889 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-61977cc6-4871-4d0c-9c4e-093833ade133 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:45.914078 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-61977cc6-4871-4d0c-9c4e-093833ade133 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:45.915628 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-61977cc6-4871-4d0c-9c4e-093833ade133 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:45.916820 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-61977cc6-4871-4d0c-9c4e-093833ade133 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b" status: 200 len: 1731 microversion: 2.20 time: 0.268402 Jul 30 05:04:45.931063 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 463/972] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:04:45 2022] GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b => generated 1731 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 05:04:45.939186 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-4aca5bcc-1558-4348-87c8-4ecb4f5f3325 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:04:45.939812 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-4aca5bcc-1558-4348-87c8-4ecb4f5f3325 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] [instance: 8520739a-9a63-4295-843a-b86a4aa10cab] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:04:45.945867 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4aca5bcc-1558-4348-87c8-4ecb4f5f3325 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:45.946329 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4aca5bcc-1558-4348-87c8-4ecb4f5f3325 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:45.947154 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4aca5bcc-1558-4348-87c8-4ecb4f5f3325 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:45.947599 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4aca5bcc-1558-4348-87c8-4ecb4f5f3325 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:45.976703 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-c05da785-f883-4e58-bb53-b1763b114296 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42d3708ddfcc491cb366054dcd5f8881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abbb209e2c194596bb3e8b9a6880646e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:45.987168 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-c05da785-f883-4e58-bb53-b1763b114296 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] 10.222.0.20 "GET /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755" status: 200 len: 1750 microversion: 2.1 time: 0.200522 Jul 30 05:04:45.987931 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 510/973] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:04:45 2022] GET /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755 => generated 1750 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:04:46.119149 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-4aca5bcc-1558-4348-87c8-4ecb4f5f3325 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407ad282edd74fb1adf62fb63306779c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db365a6a9f6041a7a8749fd1a1e3d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:46.127235 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-4aca5bcc-1558-4348-87c8-4ecb4f5f3325 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] 10.222.0.20 "GET /compute/v2.1/servers/8520739a-9a63-4295-843a-b86a4aa10cab" status: 200 len: 1263 microversion: 2.1 time: 0.195004 Jul 30 05:04:46.128075 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 464/974] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:04:45 2022] GET /compute/v2.1/servers/8520739a-9a63-4295-843a-b86a4aa10cab => generated 1263 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:04:46.944925 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-ed8ae620-33bc-4286-a256-003b7437bce3 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:04:46.945528 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-ed8ae620-33bc-4286-a256-003b7437bce3 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:04:46.952010 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ed8ae620-33bc-4286-a256-003b7437bce3 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:46.952455 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ed8ae620-33bc-4286-a256-003b7437bce3 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:46.953206 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ed8ae620-33bc-4286-a256-003b7437bce3 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:46.953687 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ed8ae620-33bc-4286-a256-003b7437bce3 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:47.008302 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-878df021-7ca6-43dd-a7f8-c00dbb99dcbe tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:04:47.008913 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-878df021-7ca6-43dd-a7f8-c00dbb99dcbe tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] [instance: 0faad1c9-0b0d-44af-92cb-dd0acd61c755] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:04:47.015640 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-878df021-7ca6-43dd-a7f8-c00dbb99dcbe tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:47.016931 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-878df021-7ca6-43dd-a7f8-c00dbb99dcbe tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:47.018682 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-878df021-7ca6-43dd-a7f8-c00dbb99dcbe tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:47.018682 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-878df021-7ca6-43dd-a7f8-c00dbb99dcbe tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:47.099330 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-ed8ae620-33bc-4286-a256-003b7437bce3 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:47.108444 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-ed8ae620-33bc-4286-a256-003b7437bce3 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:47.110108 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-ed8ae620-33bc-4286-a256-003b7437bce3 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:47.111448 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-ed8ae620-33bc-4286-a256-003b7437bce3 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b" status: 200 len: 1731 microversion: 2.20 time: 0.170442 Jul 30 05:04:47.112161 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 511/975] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:04:46 2022] GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b => generated 1731 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 05:04:47.148199 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-6f494d55-fd6d-43c9-8915-cb79f9e4e8fd tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:04:47.148829 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-6f494d55-fd6d-43c9-8915-cb79f9e4e8fd tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] [instance: 8520739a-9a63-4295-843a-b86a4aa10cab] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:04:47.154858 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6f494d55-fd6d-43c9-8915-cb79f9e4e8fd tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:47.155315 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6f494d55-fd6d-43c9-8915-cb79f9e4e8fd tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:47.156088 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6f494d55-fd6d-43c9-8915-cb79f9e4e8fd tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:47.157250 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6f494d55-fd6d-43c9-8915-cb79f9e4e8fd tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:47.173402 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-878df021-7ca6-43dd-a7f8-c00dbb99dcbe tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42d3708ddfcc491cb366054dcd5f8881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abbb209e2c194596bb3e8b9a6880646e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:47.181297 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-878df021-7ca6-43dd-a7f8-c00dbb99dcbe tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] 10.222.0.20 "GET /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755" status: 200 len: 1750 microversion: 2.1 time: 0.176932 Jul 30 05:04:47.181857 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 465/976] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:04:47 2022] GET /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755 => generated 1750 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 05:04:47.290666 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-6f494d55-fd6d-43c9-8915-cb79f9e4e8fd tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407ad282edd74fb1adf62fb63306779c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db365a6a9f6041a7a8749fd1a1e3d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:47.299368 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-6f494d55-fd6d-43c9-8915-cb79f9e4e8fd tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] 10.222.0.20 "GET /compute/v2.1/servers/8520739a-9a63-4295-843a-b86a4aa10cab" status: 200 len: 1263 microversion: 2.1 time: 0.155080 Jul 30 05:04:47.299931 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 512/977] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:04:47 2022] GET /compute/v2.1/servers/8520739a-9a63-4295-843a-b86a4aa10cab => generated 1263 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 05:04:48.135220 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-218a0afd-4502-48db-ad80-1e5f504790e4 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:04:48.135734 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-218a0afd-4502-48db-ad80-1e5f504790e4 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:04:48.142710 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-218a0afd-4502-48db-ad80-1e5f504790e4 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:48.143162 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-218a0afd-4502-48db-ad80-1e5f504790e4 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:48.143927 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-218a0afd-4502-48db-ad80-1e5f504790e4 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:48.144359 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-218a0afd-4502-48db-ad80-1e5f504790e4 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:48.203010 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-6a6e2799-957d-489a-a3b5-db45d4c46fff tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:04:48.204408 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-6a6e2799-957d-489a-a3b5-db45d4c46fff tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] [instance: 0faad1c9-0b0d-44af-92cb-dd0acd61c755] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:04:48.210936 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6a6e2799-957d-489a-a3b5-db45d4c46fff tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:48.211387 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6a6e2799-957d-489a-a3b5-db45d4c46fff tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:48.212165 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6a6e2799-957d-489a-a3b5-db45d4c46fff tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:48.212645 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6a6e2799-957d-489a-a3b5-db45d4c46fff tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:48.279332 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-218a0afd-4502-48db-ad80-1e5f504790e4 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:48.288130 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-218a0afd-4502-48db-ad80-1e5f504790e4 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:48.289643 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-218a0afd-4502-48db-ad80-1e5f504790e4 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:48.290829 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-218a0afd-4502-48db-ad80-1e5f504790e4 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b" status: 200 len: 1731 microversion: 2.20 time: 0.159576 Jul 30 05:04:48.291387 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 466/978] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:04:48 2022] GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b => generated 1731 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 05:04:48.319821 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-8b96f0b6-8957-464b-84db-bda1d425114a tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:04:48.320524 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-8b96f0b6-8957-464b-84db-bda1d425114a tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] [instance: 8520739a-9a63-4295-843a-b86a4aa10cab] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:04:48.326467 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8b96f0b6-8957-464b-84db-bda1d425114a tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:48.326984 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8b96f0b6-8957-464b-84db-bda1d425114a tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:48.327772 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8b96f0b6-8957-464b-84db-bda1d425114a tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:48.328275 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8b96f0b6-8957-464b-84db-bda1d425114a tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:48.363597 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-6a6e2799-957d-489a-a3b5-db45d4c46fff tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42d3708ddfcc491cb366054dcd5f8881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abbb209e2c194596bb3e8b9a6880646e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:48.371757 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-6a6e2799-957d-489a-a3b5-db45d4c46fff tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] 10.222.0.20 "GET /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755" status: 200 len: 1750 microversion: 2.1 time: 0.172525 Jul 30 05:04:48.372333 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 513/979] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:04:48 2022] GET /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755 => generated 1750 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 05:04:48.458829 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-8b96f0b6-8957-464b-84db-bda1d425114a tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407ad282edd74fb1adf62fb63306779c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db365a6a9f6041a7a8749fd1a1e3d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:48.466245 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-8b96f0b6-8957-464b-84db-bda1d425114a tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] 10.222.0.20 "GET /compute/v2.1/servers/8520739a-9a63-4295-843a-b86a4aa10cab" status: 200 len: 1263 microversion: 2.1 time: 0.150365 Jul 30 05:04:48.466851 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 467/980] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:04:48 2022] GET /compute/v2.1/servers/8520739a-9a63-4295-843a-b86a4aa10cab => generated 1263 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 05:04:49.315332 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-da2dcc04-68d8-4158-9b23-3bebdfb21a32 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:04:49.315975 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-da2dcc04-68d8-4158-9b23-3bebdfb21a32 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:04:49.322463 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-da2dcc04-68d8-4158-9b23-3bebdfb21a32 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:49.322975 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-da2dcc04-68d8-4158-9b23-3bebdfb21a32 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:49.323808 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-da2dcc04-68d8-4158-9b23-3bebdfb21a32 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:49.324243 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-da2dcc04-68d8-4158-9b23-3bebdfb21a32 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:49.397274 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-ca72f4b1-6e54-4ceb-86e5-3120a0d93b25 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:04:49.397995 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-ca72f4b1-6e54-4ceb-86e5-3120a0d93b25 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] [instance: 0faad1c9-0b0d-44af-92cb-dd0acd61c755] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:04:49.405782 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ca72f4b1-6e54-4ceb-86e5-3120a0d93b25 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:49.406393 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ca72f4b1-6e54-4ceb-86e5-3120a0d93b25 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:49.407862 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ca72f4b1-6e54-4ceb-86e5-3120a0d93b25 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:49.409191 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ca72f4b1-6e54-4ceb-86e5-3120a0d93b25 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:49.477206 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-da2dcc04-68d8-4158-9b23-3bebdfb21a32 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:49.487564 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-da2dcc04-68d8-4158-9b23-3bebdfb21a32 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:49.489317 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-da2dcc04-68d8-4158-9b23-3bebdfb21a32 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:49.490525 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-da2dcc04-68d8-4158-9b23-3bebdfb21a32 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b" status: 200 len: 1731 microversion: 2.20 time: 0.179728 Jul 30 05:04:49.491438 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 514/981] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:04:49 2022] GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b => generated 1731 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 05:04:49.496308 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-588c0168-521f-4580-913d-516a24546432 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:04:49.496977 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-588c0168-521f-4580-913d-516a24546432 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] [instance: 8520739a-9a63-4295-843a-b86a4aa10cab] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:04:49.504009 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-588c0168-521f-4580-913d-516a24546432 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:49.504472 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-588c0168-521f-4580-913d-516a24546432 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:49.505300 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-588c0168-521f-4580-913d-516a24546432 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:49.505956 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-588c0168-521f-4580-913d-516a24546432 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:49.591757 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-ca72f4b1-6e54-4ceb-86e5-3120a0d93b25 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42d3708ddfcc491cb366054dcd5f8881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abbb209e2c194596bb3e8b9a6880646e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:49.600833 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-ca72f4b1-6e54-4ceb-86e5-3120a0d93b25 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] 10.222.0.20 "GET /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755" status: 200 len: 1755 microversion: 2.1 time: 0.210590 Jul 30 05:04:49.601504 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 468/982] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:04:49 2022] GET /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755 => generated 1755 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 05:04:49.648903 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-588c0168-521f-4580-913d-516a24546432 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407ad282edd74fb1adf62fb63306779c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db365a6a9f6041a7a8749fd1a1e3d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:49.657189 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-588c0168-521f-4580-913d-516a24546432 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] 10.222.0.20 "GET /compute/v2.1/servers/8520739a-9a63-4295-843a-b86a4aa10cab" status: 200 len: 1263 microversion: 2.1 time: 0.163663 Jul 30 05:04:49.657762 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 515/983] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:04:49 2022] GET /compute/v2.1/servers/8520739a-9a63-4295-843a-b86a4aa10cab => generated 1263 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:04:50.519434 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-2b18f0b8-8940-426a-a72e-d342f8492c93 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:04:50.520518 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-2b18f0b8-8940-426a-a72e-d342f8492c93 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:04:50.528012 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2b18f0b8-8940-426a-a72e-d342f8492c93 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:50.528652 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2b18f0b8-8940-426a-a72e-d342f8492c93 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:50.529624 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2b18f0b8-8940-426a-a72e-d342f8492c93 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:50.530164 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2b18f0b8-8940-426a-a72e-d342f8492c93 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:50.535438 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell1:SELECT=100 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:04:50.623419 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-7670f5fb-a6de-4211-9c59-fd688eff0c72 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:04:50.624022 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-7670f5fb-a6de-4211-9c59-fd688eff0c72 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] [instance: 0faad1c9-0b0d-44af-92cb-dd0acd61c755] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:04:50.631394 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7670f5fb-a6de-4211-9c59-fd688eff0c72 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:50.631846 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7670f5fb-a6de-4211-9c59-fd688eff0c72 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:50.632619 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7670f5fb-a6de-4211-9c59-fd688eff0c72 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:50.633058 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7670f5fb-a6de-4211-9c59-fd688eff0c72 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:50.673290 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-2b18f0b8-8940-426a-a72e-d342f8492c93 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:50.681744 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-2b18f0b8-8940-426a-a72e-d342f8492c93 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:50.683322 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-2b18f0b8-8940-426a-a72e-d342f8492c93 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:50.684501 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-2b18f0b8-8940-426a-a72e-d342f8492c93 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b" status: 200 len: 1731 microversion: 2.20 time: 0.170695 Jul 30 05:04:50.685072 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 469/984] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:04:50 2022] GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b => generated 1731 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 05:04:50.690724 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-18ecb05c-ea62-4ee1-baeb-63acaaffd4bc tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:04:50.690724 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-18ecb05c-ea62-4ee1-baeb-63acaaffd4bc tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] [instance: 8520739a-9a63-4295-843a-b86a4aa10cab] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:04:50.697416 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-18ecb05c-ea62-4ee1-baeb-63acaaffd4bc tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:50.697875 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-18ecb05c-ea62-4ee1-baeb-63acaaffd4bc tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:50.698686 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-18ecb05c-ea62-4ee1-baeb-63acaaffd4bc tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:50.699142 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-18ecb05c-ea62-4ee1-baeb-63acaaffd4bc tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:50.781594 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-7670f5fb-a6de-4211-9c59-fd688eff0c72 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42d3708ddfcc491cb366054dcd5f8881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abbb209e2c194596bb3e8b9a6880646e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:50.789754 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-7670f5fb-a6de-4211-9c59-fd688eff0c72 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] 10.222.0.20 "GET /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755" status: 200 len: 1755 microversion: 2.1 time: 0.170119 Jul 30 05:04:50.790320 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 516/985] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:04:50 2022] GET /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755 => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 05:04:50.834597 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-18ecb05c-ea62-4ee1-baeb-63acaaffd4bc tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407ad282edd74fb1adf62fb63306779c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db365a6a9f6041a7a8749fd1a1e3d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:50.841901 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-18ecb05c-ea62-4ee1-baeb-63acaaffd4bc tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] 10.222.0.20 "GET /compute/v2.1/servers/8520739a-9a63-4295-843a-b86a4aa10cab" status: 200 len: 1263 microversion: 2.1 time: 0.155828 Jul 30 05:04:50.842479 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 470/986] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:04:50 2022] GET /compute/v2.1/servers/8520739a-9a63-4295-843a-b86a4aa10cab => generated 1263 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:04:51.014648 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-74ff0c6c-b862-4173-a007-7e2f2cc968c3 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:04:51.015170 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-74ff0c6c-b862-4173-a007-7e2f2cc968c3 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: 40ede213-15fc-4a6c-bec6-eef18aae6b87] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:04:51.021556 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-74ff0c6c-b862-4173-a007-7e2f2cc968c3 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:51.022013 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-74ff0c6c-b862-4173-a007-7e2f2cc968c3 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:51.022813 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-74ff0c6c-b862-4173-a007-7e2f2cc968c3 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:51.023251 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-74ff0c6c-b862-4173-a007-7e2f2cc968c3 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:51.047585 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-74ff0c6c-b862-4173-a007-7e2f2cc968c3 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/40ede213-15fc-4a6c-bec6-eef18aae6b87/ips" status: 200 len: 149 microversion: 2.1 time: 0.036129 Jul 30 05:04:51.048266 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 517/987] 10.222.0.20 () {58 vars in 1248 bytes} [Sat Jul 30 05:04:51 2022] GET /compute/v2.1/servers/40ede213-15fc-4a6c-bec6-eef18aae6b87/ips => generated 149 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 05:04:51.490481 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-76207d8b-3e39-4ba2-9448-7af00bf7dbb0 req-25f875b6-32b5-41ac-91f5-c6d7700ac2bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8520739a-9a63-4295-843a-b86a4aa10cab", "name": "network-vif-plugged", "status": "completed", "tag": "2044be95-863c-488f-8fdd-ec89733220ef"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:04:51.502047 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-76207d8b-3e39-4ba2-9448-7af00bf7dbb0 req-25f875b6-32b5-41ac-91f5-c6d7700ac2bc service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:51.502589 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-76207d8b-3e39-4ba2-9448-7af00bf7dbb0 req-25f875b6-32b5-41ac-91f5-c6d7700ac2bc service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:51.514130 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-76207d8b-3e39-4ba2-9448-7af00bf7dbb0 req-25f875b6-32b5-41ac-91f5-c6d7700ac2bc service nova] Creating event network-vif-plugged:2044be95-863c-488f-8fdd-ec89733220ef for instance 8520739a-9a63-4295-843a-b86a4aa10cab on hv-cinder-85127 Jul 30 05:04:51.520666 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-76207d8b-3e39-4ba2-9448-7af00bf7dbb0 req-25f875b6-32b5-41ac-91f5-c6d7700ac2bc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036119 Jul 30 05:04:51.521313 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 471/988] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Jul 30 05:04:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 05:04:51.710990 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-ea71ecf4-3785-41e7-90ec-3069abab8e15 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:04:51.711751 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-ea71ecf4-3785-41e7-90ec-3069abab8e15 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:04:51.730775 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ea71ecf4-3785-41e7-90ec-3069abab8e15 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:51.731713 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ea71ecf4-3785-41e7-90ec-3069abab8e15 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:51.732942 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ea71ecf4-3785-41e7-90ec-3069abab8e15 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:51.733544 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ea71ecf4-3785-41e7-90ec-3069abab8e15 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:51.813243 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-23692982-1855-4db5-b92b-2311cbbddff6 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:04:51.814210 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-23692982-1855-4db5-b92b-2311cbbddff6 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] [instance: 0faad1c9-0b0d-44af-92cb-dd0acd61c755] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:04:51.826526 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-23692982-1855-4db5-b92b-2311cbbddff6 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:51.827257 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-23692982-1855-4db5-b92b-2311cbbddff6 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:51.829378 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-23692982-1855-4db5-b92b-2311cbbddff6 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:51.830135 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-23692982-1855-4db5-b92b-2311cbbddff6 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:51.927013 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-ea71ecf4-3785-41e7-90ec-3069abab8e15 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:51.935453 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-ea71ecf4-3785-41e7-90ec-3069abab8e15 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:51.936956 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-ea71ecf4-3785-41e7-90ec-3069abab8e15 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:51.938821 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-ea71ecf4-3785-41e7-90ec-3069abab8e15 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b" status: 200 len: 1731 microversion: 2.20 time: 0.233926 Jul 30 05:04:51.939378 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 518/989] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:04:51 2022] GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b => generated 1731 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 05:04:51.943700 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-f885e5ab-8f42-41f9-becf-b8de2af64cc8 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:04:51.944297 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-f885e5ab-8f42-41f9-becf-b8de2af64cc8 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] [instance: 8520739a-9a63-4295-843a-b86a4aa10cab] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:04:51.950466 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f885e5ab-8f42-41f9-becf-b8de2af64cc8 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:51.950915 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f885e5ab-8f42-41f9-becf-b8de2af64cc8 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:51.951674 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f885e5ab-8f42-41f9-becf-b8de2af64cc8 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:51.952159 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f885e5ab-8f42-41f9-becf-b8de2af64cc8 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:52.008565 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-23692982-1855-4db5-b92b-2311cbbddff6 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42d3708ddfcc491cb366054dcd5f8881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abbb209e2c194596bb3e8b9a6880646e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:52.024882 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-23692982-1855-4db5-b92b-2311cbbddff6 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] 10.222.0.20 "GET /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755" status: 200 len: 1755 microversion: 2.1 time: 0.209861 Jul 30 05:04:52.025332 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 472/990] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:04:51 2022] GET /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755 => generated 1755 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 05:04:52.097663 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-f885e5ab-8f42-41f9-becf-b8de2af64cc8 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407ad282edd74fb1adf62fb63306779c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db365a6a9f6041a7a8749fd1a1e3d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:52.105112 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-f885e5ab-8f42-41f9-becf-b8de2af64cc8 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] 10.222.0.20 "GET /compute/v2.1/servers/8520739a-9a63-4295-843a-b86a4aa10cab" status: 200 len: 1263 microversion: 2.1 time: 0.164802 Jul 30 05:04:52.105673 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 519/991] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:04:51 2022] GET /compute/v2.1/servers/8520739a-9a63-4295-843a-b86a4aa10cab => generated 1263 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:04:52.376311 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-8a6e9254-8d72-4b26-ab38-2a34bceb41d2 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d5080bb7-5d04-4797-9d78-cb9bb36c7b50"}} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:04:52.378688 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-8a6e9254-8d72-4b26-ab38-2a34bceb41d2 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: 40ede213-15fc-4a6c-bec6-eef18aae6b87] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:04:52.384634 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8a6e9254-8d72-4b26-ab38-2a34bceb41d2 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:52.385083 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8a6e9254-8d72-4b26-ab38-2a34bceb41d2 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:52.385839 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8a6e9254-8d72-4b26-ab38-2a34bceb41d2 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:52.386270 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8a6e9254-8d72-4b26-ab38-2a34bceb41d2 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:52.800947 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-8a6e9254-8d72-4b26-ab38-2a34bceb41d2 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "POST /compute/v2.1/servers/40ede213-15fc-4a6c-bec6-eef18aae6b87/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.429155 Jul 30 05:04:52.801620 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 473/992] 10.222.0.20 () {60 vars in 1323 bytes} [Sat Jul 30 05:04:52 2022] POST /compute/v2.1/servers/40ede213-15fc-4a6c-bec6-eef18aae6b87/os-volume_attachments => generated 194 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 05:04:52.964027 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-01f1cbeb-f2e4-438e-8fde-356eec8b46d9 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:04:52.964760 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-01f1cbeb-f2e4-438e-8fde-356eec8b46d9 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:04:52.973674 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-01f1cbeb-f2e4-438e-8fde-356eec8b46d9 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:52.974318 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-01f1cbeb-f2e4-438e-8fde-356eec8b46d9 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:52.975126 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-01f1cbeb-f2e4-438e-8fde-356eec8b46d9 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:52.976988 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-01f1cbeb-f2e4-438e-8fde-356eec8b46d9 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:53.048047 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-f81aee5a-80e9-4c75-8476-baff8d5d2082 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:04:53.048821 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-f81aee5a-80e9-4c75-8476-baff8d5d2082 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] [instance: 0faad1c9-0b0d-44af-92cb-dd0acd61c755] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:04:53.055568 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f81aee5a-80e9-4c75-8476-baff8d5d2082 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:53.056111 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f81aee5a-80e9-4c75-8476-baff8d5d2082 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:53.057111 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f81aee5a-80e9-4c75-8476-baff8d5d2082 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:53.057617 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f81aee5a-80e9-4c75-8476-baff8d5d2082 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:53.138906 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-01f1cbeb-f2e4-438e-8fde-356eec8b46d9 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:53.147856 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-01f1cbeb-f2e4-438e-8fde-356eec8b46d9 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:53.149368 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-01f1cbeb-f2e4-438e-8fde-356eec8b46d9 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:53.150553 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-01f1cbeb-f2e4-438e-8fde-356eec8b46d9 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b" status: 200 len: 1731 microversion: 2.20 time: 0.190495 Jul 30 05:04:53.151105 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 520/993] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:04:52 2022] GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b => generated 1731 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 05:04:53.155434 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-d5003939-34a6-4636-b86f-881218b7f787 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:04:53.156039 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-d5003939-34a6-4636-b86f-881218b7f787 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] [instance: 8520739a-9a63-4295-843a-b86a4aa10cab] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:04:53.162945 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d5003939-34a6-4636-b86f-881218b7f787 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:53.163398 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d5003939-34a6-4636-b86f-881218b7f787 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:53.164169 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d5003939-34a6-4636-b86f-881218b7f787 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:53.164605 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d5003939-34a6-4636-b86f-881218b7f787 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:53.212386 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-f81aee5a-80e9-4c75-8476-baff8d5d2082 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42d3708ddfcc491cb366054dcd5f8881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abbb209e2c194596bb3e8b9a6880646e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:53.221529 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-f81aee5a-80e9-4c75-8476-baff8d5d2082 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] 10.222.0.20 "GET /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755" status: 200 len: 1755 microversion: 2.1 time: 0.178528 Jul 30 05:04:53.222065 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 474/994] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:04:53 2022] GET /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755 => generated 1755 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 05:04:53.303085 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-d5003939-34a6-4636-b86f-881218b7f787 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407ad282edd74fb1adf62fb63306779c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db365a6a9f6041a7a8749fd1a1e3d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:53.311123 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-d5003939-34a6-4636-b86f-881218b7f787 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] 10.222.0.20 "GET /compute/v2.1/servers/8520739a-9a63-4295-843a-b86a4aa10cab" status: 200 len: 1451 microversion: 2.1 time: 0.159078 Jul 30 05:04:53.311695 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 521/995] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:04:53 2022] GET /compute/v2.1/servers/8520739a-9a63-4295-843a-b86a4aa10cab => generated 1451 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:04:53.332553 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-0efffd08-1d42-4848-a556-5fee4000b98f tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:04:53.333173 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-0efffd08-1d42-4848-a556-5fee4000b98f tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] [instance: 8520739a-9a63-4295-843a-b86a4aa10cab] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:04:53.335150 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:04:53.341430 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0efffd08-1d42-4848-a556-5fee4000b98f tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:53.341889 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0efffd08-1d42-4848-a556-5fee4000b98f tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:53.342697 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0efffd08-1d42-4848-a556-5fee4000b98f tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:53.343137 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0efffd08-1d42-4848-a556-5fee4000b98f tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:53.486722 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-0efffd08-1d42-4848-a556-5fee4000b98f tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407ad282edd74fb1adf62fb63306779c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db365a6a9f6041a7a8749fd1a1e3d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:53.494661 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-0efffd08-1d42-4848-a556-5fee4000b98f tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] 10.222.0.20 "GET /compute/v2.1/servers/8520739a-9a63-4295-843a-b86a4aa10cab" status: 200 len: 1451 microversion: 2.1 time: 0.166713 Jul 30 05:04:53.495431 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 475/996] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:04:53 2022] GET /compute/v2.1/servers/8520739a-9a63-4295-843a-b86a4aa10cab => generated 1451 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:04:53.554734 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-6fc3683c-438d-4e1a-a8d9-6f3752a05dda req-cb44ce04-cf18-494d-9cab-77c3313126b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b", "name": "network-vif-plugged", "status": "completed", "tag": "6ca5af71-3aff-4af4-9271-ac47c637cc34"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:04:53.565072 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-6fc3683c-438d-4e1a-a8d9-6f3752a05dda req-cb44ce04-cf18-494d-9cab-77c3313126b8 service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:53.565600 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-6fc3683c-438d-4e1a-a8d9-6f3752a05dda req-cb44ce04-cf18-494d-9cab-77c3313126b8 service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:53.576868 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-6fc3683c-438d-4e1a-a8d9-6f3752a05dda req-cb44ce04-cf18-494d-9cab-77c3313126b8 service nova] Creating event network-vif-plugged:6ca5af71-3aff-4af4-9271-ac47c637cc34 for instance b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b on hv-cinder-85127 Jul 30 05:04:53.586645 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-6fc3683c-438d-4e1a-a8d9-6f3752a05dda req-cb44ce04-cf18-494d-9cab-77c3313126b8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035532 Jul 30 05:04:53.587344 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 522/997] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Jul 30 05:04:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 05:04:54.176044 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-e3ea523d-1f0a-4ef5-b1cc-c22c311c0426 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:04:54.176693 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-e3ea523d-1f0a-4ef5-b1cc-c22c311c0426 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:04:54.183116 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e3ea523d-1f0a-4ef5-b1cc-c22c311c0426 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:54.183563 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e3ea523d-1f0a-4ef5-b1cc-c22c311c0426 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:54.184324 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e3ea523d-1f0a-4ef5-b1cc-c22c311c0426 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:54.184817 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e3ea523d-1f0a-4ef5-b1cc-c22c311c0426 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:54.243453 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-ee7c36f8-15ef-4d50-aaa4-7f47b11c0878 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:04:54.244163 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-ee7c36f8-15ef-4d50-aaa4-7f47b11c0878 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] [instance: 0faad1c9-0b0d-44af-92cb-dd0acd61c755] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:04:54.251234 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ee7c36f8-15ef-4d50-aaa4-7f47b11c0878 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:54.251687 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ee7c36f8-15ef-4d50-aaa4-7f47b11c0878 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:54.252465 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ee7c36f8-15ef-4d50-aaa4-7f47b11c0878 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:54.252909 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ee7c36f8-15ef-4d50-aaa4-7f47b11c0878 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:54.418721 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-ee7c36f8-15ef-4d50-aaa4-7f47b11c0878 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42d3708ddfcc491cb366054dcd5f8881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abbb209e2c194596bb3e8b9a6880646e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:54.427770 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-ee7c36f8-15ef-4d50-aaa4-7f47b11c0878 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] 10.222.0.20 "GET /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755" status: 200 len: 1755 microversion: 2.1 time: 0.188562 Jul 30 05:04:54.428353 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 523/998] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:04:54 2022] GET /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755 => generated 1755 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 05:04:54.433039 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-e3ea523d-1f0a-4ef5-b1cc-c22c311c0426 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:54.442291 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-e3ea523d-1f0a-4ef5-b1cc-c22c311c0426 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:54.443965 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-e3ea523d-1f0a-4ef5-b1cc-c22c311c0426 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:54.445143 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-e3ea523d-1f0a-4ef5-b1cc-c22c311c0426 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b" status: 200 len: 1731 microversion: 2.20 time: 0.273705 Jul 30 05:04:54.445707 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 476/999] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:04:54 2022] GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b => generated 1731 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 05:04:55.449035 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-e8cb0dd6-4e9d-4a92-9a30-86fe02831729 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:04:55.449652 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-e8cb0dd6-4e9d-4a92-9a30-86fe02831729 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] [instance: 0faad1c9-0b0d-44af-92cb-dd0acd61c755] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:04:55.457797 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e8cb0dd6-4e9d-4a92-9a30-86fe02831729 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:55.458454 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e8cb0dd6-4e9d-4a92-9a30-86fe02831729 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:55.459356 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e8cb0dd6-4e9d-4a92-9a30-86fe02831729 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:55.459879 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e8cb0dd6-4e9d-4a92-9a30-86fe02831729 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:55.471161 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-15f25a33-f446-46a7-9ccf-0376bf2beb18 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:04:55.471786 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-15f25a33-f446-46a7-9ccf-0376bf2beb18 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:04:55.479090 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-15f25a33-f446-46a7-9ccf-0376bf2beb18 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:55.479498 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-15f25a33-f446-46a7-9ccf-0376bf2beb18 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:55.480435 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-15f25a33-f446-46a7-9ccf-0376bf2beb18 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:55.480876 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-15f25a33-f446-46a7-9ccf-0376bf2beb18 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:55.637776 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-e8cb0dd6-4e9d-4a92-9a30-86fe02831729 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42d3708ddfcc491cb366054dcd5f8881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abbb209e2c194596bb3e8b9a6880646e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:55.648100 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-e8cb0dd6-4e9d-4a92-9a30-86fe02831729 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] 10.222.0.20 "GET /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755" status: 200 len: 1755 microversion: 2.1 time: 0.202727 Jul 30 05:04:55.649351 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 524/1000] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:04:55 2022] GET /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755 => generated 1755 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:04:55.666531 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-15f25a33-f446-46a7-9ccf-0376bf2beb18 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:55.677731 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-15f25a33-f446-46a7-9ccf-0376bf2beb18 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:55.684684 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-15f25a33-f446-46a7-9ccf-0376bf2beb18 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:55.686340 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-15f25a33-f446-46a7-9ccf-0376bf2beb18 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b" status: 200 len: 1731 microversion: 2.20 time: 0.221369 Jul 30 05:04:55.691622 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 477/1001] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:04:55 2022] GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b => generated 1731 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 05:04:55.735091 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-cce18151-baca-4d5d-9074-6b9ec4713f77 req-31bd0012-262f-470a-b991-2ecc8f598a87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8520739a-9a63-4295-843a-b86a4aa10cab", "tag": "2044be95-863c-488f-8fdd-ec89733220ef"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:04:55.745012 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-cce18151-baca-4d5d-9074-6b9ec4713f77 req-31bd0012-262f-470a-b991-2ecc8f598a87 service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:55.745678 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-cce18151-baca-4d5d-9074-6b9ec4713f77 req-31bd0012-262f-470a-b991-2ecc8f598a87 service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:55.758092 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-cce18151-baca-4d5d-9074-6b9ec4713f77 req-31bd0012-262f-470a-b991-2ecc8f598a87 service nova] Creating event network-changed:2044be95-863c-488f-8fdd-ec89733220ef for instance 8520739a-9a63-4295-843a-b86a4aa10cab on hv-cinder-85127 Jul 30 05:04:55.763217 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-cce18151-baca-4d5d-9074-6b9ec4713f77 req-31bd0012-262f-470a-b991-2ecc8f598a87 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035326 Jul 30 05:04:55.764117 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 525/1002] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Jul 30 05:04:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 05:04:56.671153 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-def63465-bb6c-4481-8f66-9c36a3576bce tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:04:56.672424 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-def63465-bb6c-4481-8f66-9c36a3576bce tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] [instance: 0faad1c9-0b0d-44af-92cb-dd0acd61c755] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:04:56.679250 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-def63465-bb6c-4481-8f66-9c36a3576bce tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:56.679696 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-def63465-bb6c-4481-8f66-9c36a3576bce tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:56.680465 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-def63465-bb6c-4481-8f66-9c36a3576bce tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:56.680899 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-def63465-bb6c-4481-8f66-9c36a3576bce tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:56.714597 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-9f7579d4-005a-415d-8e54-ac7fa158cd50 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:04:56.715772 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-9f7579d4-005a-415d-8e54-ac7fa158cd50 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:04:56.723535 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9f7579d4-005a-415d-8e54-ac7fa158cd50 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:56.724087 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9f7579d4-005a-415d-8e54-ac7fa158cd50 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:56.725065 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9f7579d4-005a-415d-8e54-ac7fa158cd50 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:56.725637 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9f7579d4-005a-415d-8e54-ac7fa158cd50 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:56.856520 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-def63465-bb6c-4481-8f66-9c36a3576bce tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42d3708ddfcc491cb366054dcd5f8881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abbb209e2c194596bb3e8b9a6880646e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:56.867760 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-def63465-bb6c-4481-8f66-9c36a3576bce tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] 10.222.0.20 "GET /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755" status: 200 len: 1755 microversion: 2.1 time: 0.200654 Jul 30 05:04:56.868628 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 478/1003] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:04:56 2022] GET /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755 => generated 1755 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:04:56.883746 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-9f7579d4-005a-415d-8e54-ac7fa158cd50 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:56.893551 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-9f7579d4-005a-415d-8e54-ac7fa158cd50 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:56.895809 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-9f7579d4-005a-415d-8e54-ac7fa158cd50 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:56.897071 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-9f7579d4-005a-415d-8e54-ac7fa158cd50 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b" status: 200 len: 1718 microversion: 2.20 time: 0.187430 Jul 30 05:04:56.897995 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 526/1004] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:04:56 2022] GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b => generated 1718 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 05:04:57.889624 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-1657e120-13e9-441c-b6d9-2734bc4b3afa tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:04:57.890238 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-1657e120-13e9-441c-b6d9-2734bc4b3afa tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] [instance: 0faad1c9-0b0d-44af-92cb-dd0acd61c755] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:04:57.897477 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1657e120-13e9-441c-b6d9-2734bc4b3afa tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:57.897925 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1657e120-13e9-441c-b6d9-2734bc4b3afa tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:57.898716 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1657e120-13e9-441c-b6d9-2734bc4b3afa tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:57.899156 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1657e120-13e9-441c-b6d9-2734bc4b3afa tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:58.049140 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-1657e120-13e9-441c-b6d9-2734bc4b3afa tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42d3708ddfcc491cb366054dcd5f8881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abbb209e2c194596bb3e8b9a6880646e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:58.057599 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-1657e120-13e9-441c-b6d9-2734bc4b3afa tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] 10.222.0.20 "GET /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755" status: 200 len: 1755 microversion: 2.1 time: 0.171932 Jul 30 05:04:58.058264 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 479/1005] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:04:57 2022] GET /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755 => generated 1755 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:04:59.081433 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-b38c58a4-594d-4a94-bd72-60b9cd880049 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:04:59.082080 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-b38c58a4-594d-4a94-bd72-60b9cd880049 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] [instance: 0faad1c9-0b0d-44af-92cb-dd0acd61c755] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:04:59.088707 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b38c58a4-594d-4a94-bd72-60b9cd880049 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:59.089162 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b38c58a4-594d-4a94-bd72-60b9cd880049 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:59.089933 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b38c58a4-594d-4a94-bd72-60b9cd880049 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:04:59.090372 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b38c58a4-594d-4a94-bd72-60b9cd880049 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:04:59.105031 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:04:59.239639 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-b38c58a4-594d-4a94-bd72-60b9cd880049 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42d3708ddfcc491cb366054dcd5f8881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abbb209e2c194596bb3e8b9a6880646e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:04:59.247769 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-b38c58a4-594d-4a94-bd72-60b9cd880049 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] 10.222.0.20 "GET /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755" status: 200 len: 1755 microversion: 2.1 time: 0.170316 Jul 30 05:04:59.248537 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 527/1006] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:04:59 2022] GET /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755 => generated 1755 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:05:00.269955 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-a313ca4e-6534-4ffa-9f71-3666eaac31d1 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:05:00.270591 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-a313ca4e-6534-4ffa-9f71-3666eaac31d1 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] [instance: 0faad1c9-0b0d-44af-92cb-dd0acd61c755] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:05:00.277218 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a313ca4e-6534-4ffa-9f71-3666eaac31d1 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:00.277662 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a313ca4e-6534-4ffa-9f71-3666eaac31d1 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:00.278476 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a313ca4e-6534-4ffa-9f71-3666eaac31d1 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:00.278948 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a313ca4e-6534-4ffa-9f71-3666eaac31d1 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:00.437804 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-a313ca4e-6534-4ffa-9f71-3666eaac31d1 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42d3708ddfcc491cb366054dcd5f8881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abbb209e2c194596bb3e8b9a6880646e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:05:00.446414 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-a313ca4e-6534-4ffa-9f71-3666eaac31d1 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] 10.222.0.20 "GET /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755" status: 200 len: 1755 microversion: 2.1 time: 0.180952 Jul 30 05:05:00.447014 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 480/1007] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:05:00 2022] GET /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755 => generated 1755 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:05:00.519212 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-3a3d8d35-6d30-428c-9359-b752fc816b46 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:05:00.519717 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-3a3d8d35-6d30-428c-9359-b752fc816b46 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: 40ede213-15fc-4a6c-bec6-eef18aae6b87] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:05:00.526557 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3a3d8d35-6d30-428c-9359-b752fc816b46 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:00.526801 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3a3d8d35-6d30-428c-9359-b752fc816b46 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:00.527570 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3a3d8d35-6d30-428c-9359-b752fc816b46 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:00.528009 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-3a3d8d35-6d30-428c-9359-b752fc816b46 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:00.614491 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.objects.instance [None req-3a3d8d35-6d30-428c-9359-b752fc816b46 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lazy-loading 'services' on Instance uuid 40ede213-15fc-4a6c-bec6-eef18aae6b87 {{(pid=117886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 05:05:00.690725 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-3a3d8d35-6d30-428c-9359-b752fc816b46 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "DELETE /compute/v2.1/servers/40ede213-15fc-4a6c-bec6-eef18aae6b87/os-volume_attachments/d5080bb7-5d04-4797-9d78-cb9bb36c7b50" status: 202 len: 0 microversion: 2.1 time: 0.175476 Jul 30 05:05:00.691338 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 528/1008] 10.222.0.20 () {58 vars in 1416 bytes} [Sat Jul 30 05:05:00 2022] DELETE /compute/v2.1/servers/40ede213-15fc-4a6c-bec6-eef18aae6b87/os-volume_attachments/d5080bb7-5d04-4797-9d78-cb9bb36c7b50 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 05:05:00.699524 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-63b18bc8-e1a8-45dd-9fc6-082e9b80af67 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:05:00.701931 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-63b18bc8-e1a8-45dd-9fc6-082e9b80af67 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: 40ede213-15fc-4a6c-bec6-eef18aae6b87] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:05:00.710038 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-63b18bc8-e1a8-45dd-9fc6-082e9b80af67 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:00.710883 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-63b18bc8-e1a8-45dd-9fc6-082e9b80af67 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:00.711930 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-63b18bc8-e1a8-45dd-9fc6-082e9b80af67 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:00.712375 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-63b18bc8-e1a8-45dd-9fc6-082e9b80af67 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:00.745890 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-63b18bc8-e1a8-45dd-9fc6-082e9b80af67 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/40ede213-15fc-4a6c-bec6-eef18aae6b87/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050056 Jul 30 05:05:00.746462 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 481/1009] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Jul 30 05:05:00 2022] GET /compute/v2.1/servers/40ede213-15fc-4a6c-bec6-eef18aae6b87/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 05:05:01.472055 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-19a8b7fa-e1ff-4d0a-9545-8bfc5bf4d748 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:05:01.472905 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-19a8b7fa-e1ff-4d0a-9545-8bfc5bf4d748 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] [instance: 0faad1c9-0b0d-44af-92cb-dd0acd61c755] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:05:01.479695 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-19a8b7fa-e1ff-4d0a-9545-8bfc5bf4d748 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:01.480147 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-19a8b7fa-e1ff-4d0a-9545-8bfc5bf4d748 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:01.481006 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-19a8b7fa-e1ff-4d0a-9545-8bfc5bf4d748 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:01.481446 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-19a8b7fa-e1ff-4d0a-9545-8bfc5bf4d748 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:01.629246 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-19a8b7fa-e1ff-4d0a-9545-8bfc5bf4d748 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42d3708ddfcc491cb366054dcd5f8881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abbb209e2c194596bb3e8b9a6880646e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:05:01.637321 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-19a8b7fa-e1ff-4d0a-9545-8bfc5bf4d748 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] 10.222.0.20 "GET /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755" status: 200 len: 1755 microversion: 2.1 time: 0.171686 Jul 30 05:05:01.637896 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 529/1010] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:05:01 2022] GET /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755 => generated 1755 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:05:01.758083 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-7dd88717-b878-44c0-bd54-f95231c9f3ad tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:05:01.760435 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-7dd88717-b878-44c0-bd54-f95231c9f3ad tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: 40ede213-15fc-4a6c-bec6-eef18aae6b87] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:05:01.767651 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7dd88717-b878-44c0-bd54-f95231c9f3ad tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:01.768089 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7dd88717-b878-44c0-bd54-f95231c9f3ad tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:01.768848 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7dd88717-b878-44c0-bd54-f95231c9f3ad tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:01.769280 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7dd88717-b878-44c0-bd54-f95231c9f3ad tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:01.797255 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-7dd88717-b878-44c0-bd54-f95231c9f3ad tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/40ede213-15fc-4a6c-bec6-eef18aae6b87/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043092 Jul 30 05:05:01.797857 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 482/1011] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Jul 30 05:05:01 2022] GET /compute/v2.1/servers/40ede213-15fc-4a6c-bec6-eef18aae6b87/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 30 05:05:01.861372 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-5dfb906c-fcf5-49b1-ad74-f27ee1e7dc57 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:05:01.861872 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-5dfb906c-fcf5-49b1-ad74-f27ee1e7dc57 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: 40ede213-15fc-4a6c-bec6-eef18aae6b87] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:05:01.867933 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5dfb906c-fcf5-49b1-ad74-f27ee1e7dc57 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:01.868387 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5dfb906c-fcf5-49b1-ad74-f27ee1e7dc57 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:01.869152 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5dfb906c-fcf5-49b1-ad74-f27ee1e7dc57 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:01.869590 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-5dfb906c-fcf5-49b1-ad74-f27ee1e7dc57 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:01.895827 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-5dfb906c-fcf5-49b1-ad74-f27ee1e7dc57 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: 40ede213-15fc-4a6c-bec6-eef18aae6b87] Going to try to terminate instance {{(pid=117886) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 05:05:01.972506 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-5dfb906c-fcf5-49b1-ad74-f27ee1e7dc57 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "DELETE /compute/v2.1/servers/40ede213-15fc-4a6c-bec6-eef18aae6b87" status: 204 len: 0 microversion: 2.1 time: 0.115605 Jul 30 05:05:01.973115 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 530/1012] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Jul 30 05:05:01 2022] DELETE /compute/v2.1/servers/40ede213-15fc-4a6c-bec6-eef18aae6b87 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 05:05:01.982392 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-d6aef90e-a368-46cd-a320-e6eff1a2ec7c tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:05:01.983087 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-d6aef90e-a368-46cd-a320-e6eff1a2ec7c tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: 40ede213-15fc-4a6c-bec6-eef18aae6b87] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:05:01.989730 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d6aef90e-a368-46cd-a320-e6eff1a2ec7c tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:01.990168 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d6aef90e-a368-46cd-a320-e6eff1a2ec7c tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:01.990983 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d6aef90e-a368-46cd-a320-e6eff1a2ec7c tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:01.991416 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d6aef90e-a368-46cd-a320-e6eff1a2ec7c tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:02.120390 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-d6aef90e-a368-46cd-a320-e6eff1a2ec7c tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8abb58f9c274e568d2d0fe3d4df11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01500cb03c74d1082090cd1c1836169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:05:02.127834 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-d6aef90e-a368-46cd-a320-e6eff1a2ec7c tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/40ede213-15fc-4a6c-bec6-eef18aae6b87" status: 200 len: 1681 microversion: 2.1 time: 0.149961 Jul 30 05:05:02.128395 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 483/1013] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:05:01 2022] GET /compute/v2.1/servers/40ede213-15fc-4a6c-bec6-eef18aae6b87 => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:05:02.659957 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-1a6449d3-6809-4cc0-8dda-4ac38f9c176c tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:05:02.660709 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-1a6449d3-6809-4cc0-8dda-4ac38f9c176c tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] [instance: 0faad1c9-0b0d-44af-92cb-dd0acd61c755] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:05:02.666706 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1a6449d3-6809-4cc0-8dda-4ac38f9c176c tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:02.667163 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1a6449d3-6809-4cc0-8dda-4ac38f9c176c tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:02.668036 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1a6449d3-6809-4cc0-8dda-4ac38f9c176c tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:02.668484 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1a6449d3-6809-4cc0-8dda-4ac38f9c176c tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:02.816171 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-1a6449d3-6809-4cc0-8dda-4ac38f9c176c tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42d3708ddfcc491cb366054dcd5f8881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abbb209e2c194596bb3e8b9a6880646e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:05:02.824351 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-1a6449d3-6809-4cc0-8dda-4ac38f9c176c tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] 10.222.0.20 "GET /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755" status: 200 len: 1755 microversion: 2.1 time: 0.168593 Jul 30 05:05:02.824922 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 531/1014] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:05:02 2022] GET /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755 => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:05:03.149103 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-485a1dea-ec97-41e8-b3c7-ed37103490b7 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:05:03.149727 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-485a1dea-ec97-41e8-b3c7-ed37103490b7 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: 40ede213-15fc-4a6c-bec6-eef18aae6b87] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:05:03.156361 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-485a1dea-ec97-41e8-b3c7-ed37103490b7 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:03.156825 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-485a1dea-ec97-41e8-b3c7-ed37103490b7 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:03.157641 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-485a1dea-ec97-41e8-b3c7-ed37103490b7 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:03.158084 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-485a1dea-ec97-41e8-b3c7-ed37103490b7 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:03.286546 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-485a1dea-ec97-41e8-b3c7-ed37103490b7 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8abb58f9c274e568d2d0fe3d4df11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01500cb03c74d1082090cd1c1836169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:05:03.294354 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-485a1dea-ec97-41e8-b3c7-ed37103490b7 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/40ede213-15fc-4a6c-bec6-eef18aae6b87" status: 200 len: 1681 microversion: 2.1 time: 0.149124 Jul 30 05:05:03.295221 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 484/1015] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:05:03 2022] GET /compute/v2.1/servers/40ede213-15fc-4a6c-bec6-eef18aae6b87 => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:05:03.845104 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-d2ca1974-0d7a-45dd-a9fb-7d255460c00a tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:05:03.845812 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-d2ca1974-0d7a-45dd-a9fb-7d255460c00a tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] [instance: 0faad1c9-0b0d-44af-92cb-dd0acd61c755] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:05:03.853264 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d2ca1974-0d7a-45dd-a9fb-7d255460c00a tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:03.853849 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d2ca1974-0d7a-45dd-a9fb-7d255460c00a tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:03.854842 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d2ca1974-0d7a-45dd-a9fb-7d255460c00a tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:03.855412 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d2ca1974-0d7a-45dd-a9fb-7d255460c00a tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:04.000970 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-d2ca1974-0d7a-45dd-a9fb-7d255460c00a tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42d3708ddfcc491cb366054dcd5f8881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abbb209e2c194596bb3e8b9a6880646e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:05:04.008998 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-d2ca1974-0d7a-45dd-a9fb-7d255460c00a tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] 10.222.0.20 "GET /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755" status: 200 len: 1755 microversion: 2.1 time: 0.167709 Jul 30 05:05:04.021567 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 532/1016] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:05:03 2022] GET /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755 => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:05:04.317661 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-7b848211-8089-4b79-b962-f5faee8c1bc1 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:05:04.318421 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-7b848211-8089-4b79-b962-f5faee8c1bc1 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: 40ede213-15fc-4a6c-bec6-eef18aae6b87] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:05:04.324867 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7b848211-8089-4b79-b962-f5faee8c1bc1 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:04.325307 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7b848211-8089-4b79-b962-f5faee8c1bc1 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:04.326069 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7b848211-8089-4b79-b962-f5faee8c1bc1 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:04.326544 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7b848211-8089-4b79-b962-f5faee8c1bc1 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:04.330631 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:05:04.416799 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-7b848211-8089-4b79-b962-f5faee8c1bc1 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8abb58f9c274e568d2d0fe3d4df11de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01500cb03c74d1082090cd1c1836169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:05:04.425804 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-7b848211-8089-4b79-b962-f5faee8c1bc1 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/40ede213-15fc-4a6c-bec6-eef18aae6b87" status: 200 len: 1613 microversion: 2.1 time: 0.112796 Jul 30 05:05:04.426388 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 485/1017] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:05:04 2022] GET /compute/v2.1/servers/40ede213-15fc-4a6c-bec6-eef18aae6b87 => generated 1613 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:05:04.544555 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-4f05ba77-5806-43e3-b83d-54b86a5edb71 req-8d393eec-cd27-47b6-bfd3-60431262cecb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40ede213-15fc-4a6c-bec6-eef18aae6b87", "name": "network-vif-deleted", "tag": "71dbf2c2-385e-484d-a2ac-d51216c17d84"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:05:04.574364 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-4f05ba77-5806-43e3-b83d-54b86a5edb71 req-8d393eec-cd27-47b6-bfd3-60431262cecb service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:04.575986 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-4f05ba77-5806-43e3-b83d-54b86a5edb71 req-8d393eec-cd27-47b6-bfd3-60431262cecb service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:04.595233 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-4f05ba77-5806-43e3-b83d-54b86a5edb71 req-8d393eec-cd27-47b6-bfd3-60431262cecb service nova] Creating event network-vif-deleted:71dbf2c2-385e-484d-a2ac-d51216c17d84 for instance 40ede213-15fc-4a6c-bec6-eef18aae6b87 on hv-cinder-85127 Jul 30 05:05:04.600465 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-4f05ba77-5806-43e3-b83d-54b86a5edb71 req-8d393eec-cd27-47b6-bfd3-60431262cecb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063538 Jul 30 05:05:04.601432 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 533/1018] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Jul 30 05:05:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 05:05:05.031102 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-a0741f8e-b42b-488a-96ce-b7a673fdba29 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:05:05.032076 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-a0741f8e-b42b-488a-96ce-b7a673fdba29 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] [instance: 0faad1c9-0b0d-44af-92cb-dd0acd61c755] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:05:05.038273 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a0741f8e-b42b-488a-96ce-b7a673fdba29 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:05.039005 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a0741f8e-b42b-488a-96ce-b7a673fdba29 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:05.039876 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a0741f8e-b42b-488a-96ce-b7a673fdba29 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:05.040325 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a0741f8e-b42b-488a-96ce-b7a673fdba29 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:05.194711 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-a0741f8e-b42b-488a-96ce-b7a673fdba29 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42d3708ddfcc491cb366054dcd5f8881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abbb209e2c194596bb3e8b9a6880646e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:05:05.203076 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-a0741f8e-b42b-488a-96ce-b7a673fdba29 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] 10.222.0.20 "GET /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755" status: 200 len: 1755 microversion: 2.1 time: 0.175763 Jul 30 05:05:05.203695 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 486/1019] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:05:05 2022] GET /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755 => generated 1755 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:05:05.448704 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-f803858f-56a8-4de5-ab8c-2fc390b9d039 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:05:05.449441 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-f803858f-56a8-4de5-ab8c-2fc390b9d039 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: 40ede213-15fc-4a6c-bec6-eef18aae6b87] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:05:05.456441 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f803858f-56a8-4de5-ab8c-2fc390b9d039 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:05.456891 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f803858f-56a8-4de5-ab8c-2fc390b9d039 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:05.457676 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f803858f-56a8-4de5-ab8c-2fc390b9d039 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:05.458114 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f803858f-56a8-4de5-ab8c-2fc390b9d039 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:05.471507 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.wsgi [None req-f803858f-56a8-4de5-ab8c-2fc390b9d039 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] HTTP exception thrown: Instance 40ede213-15fc-4a6c-bec6-eef18aae6b87 could not be found. Jul 30 05:05:05.473145 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-f803858f-56a8-4de5-ab8c-2fc390b9d039 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Request method failure captured: Jul 30 05:05:05.473145 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: request: GET /compute/v2.1/servers/40ede213-15fc-4a6c-bec6-eef18aae6b87 HTTP/1.1 Jul 30 05:05:05.473145 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Accept: application/json Jul 30 05:05:05.473145 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Accept-Encoding: identity Jul 30 05:05:05.473145 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Connection: close Jul 30 05:05:05.473145 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Content-Length: 0 Jul 30 05:05:05.473145 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Content-Type: application/json Jul 30 05:05:05.473145 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Host: 10.222.0.20 Jul 30 05:05:05.473145 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Openstack-System-Scope: None Jul 30 05:05:05.473145 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: User-Agent: python-urllib3/1.26.10 Jul 30 05:05:05.473145 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Auth-Token: gAAAAABi5LpsOyvntIvMWRkdgHAWaqLWWQheVZGRSyU7m8d_2qr8zQQH3DOakkgVq23Q75nTB9odGI0F-DQpTcNmJESi7-iRiz2-Pz62AvInyIstK7nwhx7nj-QdimoRc10ZS0jEzNztVniYwiMWef1RbG0o7cJ-tzIv7p3eOvqZTnGZgHQkQhc Jul 30 05:05:05.473145 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Domain-Id: None Jul 30 05:05:05.473145 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Domain-Name: None Jul 30 05:05:05.473145 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Identity-Status: Confirmed Jul 30 05:05:05.473145 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Is-Admin-Project: True Jul 30 05:05:05.473145 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Project-Domain-Id: default Jul 30 05:05:05.473145 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Project-Domain-Name: Default Jul 30 05:05:05.473145 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Project-Id: e01500cb03c74d1082090cd1c1836169 Jul 30 05:05:05.473145 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Project-Name: tempest-AttachVolumeNegativeTest-490621097 Jul 30 05:05:05.473145 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Role: member,reader Jul 30 05:05:05.473145 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Roles: member,reader Jul 30 05:05:05.474821 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e01500cb03c74d1082090cd1c1836169"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e01500cb03c74d1082090cd1c1836169"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e01500cb03c74d1082090cd1c1836169"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e01500cb03c74d1082090cd1c1836169"}]}] Jul 30 05:05:05.474821 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Tenant: tempest-AttachVolumeNegativeTest-490621097 Jul 30 05:05:05.474821 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Tenant-Id: e01500cb03c74d1082090cd1c1836169 Jul 30 05:05:05.474821 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-490621097 Jul 30 05:05:05.474821 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User: tempest-AttachVolumeNegativeTest-490621097-project Jul 30 05:05:05.474821 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User-Domain-Id: default Jul 30 05:05:05.474821 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User-Domain-Name: Default Jul 30 05:05:05.474821 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User-Id: a8abb58f9c274e568d2d0fe3d4df11de Jul 30 05:05:05.474821 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User-Name: tempest-AttachVolumeNegativeTest-490621097-project Jul 30 05:05:05.474821 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: method: > Jul 30 05:05:05.474821 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: exception: Instance 40ede213-15fc-4a6c-bec6-eef18aae6b87 could not be found. Jul 30 05:05:05.474821 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: action_args: {'id': '40ede213-15fc-4a6c-bec6-eef18aae6b87'} Jul 30 05:05:05.475812 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 05:05:05.475812 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:05:05.475812 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 05:05:05.475812 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 05:05:05.475812 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 05:05:05.475812 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 05:05:05.475812 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 05:05:05.475812 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 05:05:05.475812 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 05:05:05.475812 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 05:05:05.475812 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40ede213-15fc-4a6c-bec6-eef18aae6b87 could not be found. Jul 30 05:05:05.475812 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 05:05:05.475812 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 05:05:05.475812 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 05:05:05.475812 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:05:05.475812 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 05:05:05.475812 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 05:05:05.475812 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 05:05:05.475812 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 05:05:05.475812 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 05:05:05.477386 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 05:05:05.477386 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 05:05:05.477386 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 05:05:05.477386 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 05:05:05.477386 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 05:05:05.477386 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 05:05:05.477386 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 05:05:05.477386 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40ede213-15fc-4a6c-bec6-eef18aae6b87 could not be found. Jul 30 05:05:05.477386 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 05:05:05.477386 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 05:05:05.477386 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 05:05:05.477386 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:05:05.477386 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 05:05:05.477386 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 05:05:05.477386 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 05:05:05.477386 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 05:05:05.477386 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40ede213-15fc-4a6c-bec6-eef18aae6b87 could not be found. Jul 30 05:05:05.477386 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 05:05:05.478843 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-f803858f-56a8-4de5-ab8c-2fc390b9d039 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Returning 404 to user: Instance 40ede213-15fc-4a6c-bec6-eef18aae6b87 could not be found. {{(pid=117886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 05:05:05.478843 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-f803858f-56a8-4de5-ab8c-2fc390b9d039 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/40ede213-15fc-4a6c-bec6-eef18aae6b87" status: 404 len: 111 microversion: 2.1 time: 0.030545 Jul 30 05:05:05.478843 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 534/1020] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:05:05 2022] GET /compute/v2.1/servers/40ede213-15fc-4a6c-bec6-eef18aae6b87 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 05:05:05.484351 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-f3c78bbf-25b0-4af9-a19e-5b90225c4187 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '.version_select at 0x7f2daf6271f0>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:05:05.504081 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-f3c78bbf-25b0-4af9-a19e-5b90225c4187 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1410911187" status: 202 len: 0 microversion: 2.1 time: 0.023771 Jul 30 05:05:05.504667 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 487/1021] 10.222.0.20 () {58 vars in 1221 bytes} [Sat Jul 30 05:05:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1410911187 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 05:05:06.224754 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-7b186823-ae3e-42fc-b311-acf1ca36d31d tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:05:06.225428 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-7b186823-ae3e-42fc-b311-acf1ca36d31d tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] [instance: 0faad1c9-0b0d-44af-92cb-dd0acd61c755] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:05:06.231495 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7b186823-ae3e-42fc-b311-acf1ca36d31d tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:06.232026 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7b186823-ae3e-42fc-b311-acf1ca36d31d tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:06.232865 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7b186823-ae3e-42fc-b311-acf1ca36d31d tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:06.233377 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7b186823-ae3e-42fc-b311-acf1ca36d31d tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:06.455514 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-7b186823-ae3e-42fc-b311-acf1ca36d31d tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42d3708ddfcc491cb366054dcd5f8881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abbb209e2c194596bb3e8b9a6880646e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:05:06.463582 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-7b186823-ae3e-42fc-b311-acf1ca36d31d tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] 10.222.0.20 "GET /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755" status: 200 len: 1755 microversion: 2.1 time: 0.242751 Jul 30 05:05:06.464145 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 535/1022] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:05:06 2022] GET /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755 => generated 1755 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:05:07.486511 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-992342e8-137c-4d28-894c-001c13591246 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:05:07.487159 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-992342e8-137c-4d28-894c-001c13591246 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] [instance: 0faad1c9-0b0d-44af-92cb-dd0acd61c755] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:05:07.494102 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-992342e8-137c-4d28-894c-001c13591246 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:07.494586 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-992342e8-137c-4d28-894c-001c13591246 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:07.495355 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-992342e8-137c-4d28-894c-001c13591246 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:07.495797 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-992342e8-137c-4d28-894c-001c13591246 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:07.579956 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-7364c48b-02ae-45eb-b803-43dbdedcea78 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:05:07.580485 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-7364c48b-02ae-45eb-b803-43dbdedcea78 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: 40ede213-15fc-4a6c-bec6-eef18aae6b87] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:05:07.586912 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7364c48b-02ae-45eb-b803-43dbdedcea78 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:07.587361 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7364c48b-02ae-45eb-b803-43dbdedcea78 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:07.588122 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7364c48b-02ae-45eb-b803-43dbdedcea78 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:07.588554 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7364c48b-02ae-45eb-b803-43dbdedcea78 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:07.602365 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.wsgi [None req-7364c48b-02ae-45eb-b803-43dbdedcea78 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] HTTP exception thrown: Instance 40ede213-15fc-4a6c-bec6-eef18aae6b87 could not be found. Jul 30 05:05:07.604071 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-7364c48b-02ae-45eb-b803-43dbdedcea78 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Request method failure captured: Jul 30 05:05:07.604071 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: request: DELETE /compute/v2.1/servers/40ede213-15fc-4a6c-bec6-eef18aae6b87 HTTP/1.1 Jul 30 05:05:07.604071 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Accept: application/json Jul 30 05:05:07.604071 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Accept-Encoding: identity Jul 30 05:05:07.604071 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Connection: close Jul 30 05:05:07.604071 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Content-Length: 0 Jul 30 05:05:07.604071 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Content-Type: application/json Jul 30 05:05:07.604071 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Host: 10.222.0.20 Jul 30 05:05:07.604071 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Openstack-System-Scope: None Jul 30 05:05:07.604071 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: User-Agent: python-urllib3/1.26.10 Jul 30 05:05:07.604071 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Auth-Token: gAAAAABi5LpsOyvntIvMWRkdgHAWaqLWWQheVZGRSyU7m8d_2qr8zQQH3DOakkgVq23Q75nTB9odGI0F-DQpTcNmJESi7-iRiz2-Pz62AvInyIstK7nwhx7nj-QdimoRc10ZS0jEzNztVniYwiMWef1RbG0o7cJ-tzIv7p3eOvqZTnGZgHQkQhc Jul 30 05:05:07.604071 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Domain-Id: None Jul 30 05:05:07.604071 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Domain-Name: None Jul 30 05:05:07.604071 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Identity-Status: Confirmed Jul 30 05:05:07.604071 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Is-Admin-Project: True Jul 30 05:05:07.604071 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Project-Domain-Id: default Jul 30 05:05:07.604071 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Project-Domain-Name: Default Jul 30 05:05:07.604071 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Project-Id: e01500cb03c74d1082090cd1c1836169 Jul 30 05:05:07.604071 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Project-Name: tempest-AttachVolumeNegativeTest-490621097 Jul 30 05:05:07.604071 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Role: member,reader Jul 30 05:05:07.604071 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Roles: member,reader Jul 30 05:05:07.605530 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e01500cb03c74d1082090cd1c1836169"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e01500cb03c74d1082090cd1c1836169"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e01500cb03c74d1082090cd1c1836169"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e01500cb03c74d1082090cd1c1836169"}]}] Jul 30 05:05:07.605530 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Tenant: tempest-AttachVolumeNegativeTest-490621097 Jul 30 05:05:07.605530 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Tenant-Id: e01500cb03c74d1082090cd1c1836169 Jul 30 05:05:07.605530 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-490621097 Jul 30 05:05:07.605530 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User: tempest-AttachVolumeNegativeTest-490621097-project Jul 30 05:05:07.605530 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User-Domain-Id: default Jul 30 05:05:07.605530 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User-Domain-Name: Default Jul 30 05:05:07.605530 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User-Id: a8abb58f9c274e568d2d0fe3d4df11de Jul 30 05:05:07.605530 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User-Name: tempest-AttachVolumeNegativeTest-490621097-project Jul 30 05:05:07.605530 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: method: > Jul 30 05:05:07.605530 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: exception: Instance 40ede213-15fc-4a6c-bec6-eef18aae6b87 could not be found. Jul 30 05:05:07.605530 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: action_args: {'id': '40ede213-15fc-4a6c-bec6-eef18aae6b87'} Jul 30 05:05:07.606468 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 05:05:07.606468 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:05:07.606468 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 05:05:07.606468 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 05:05:07.606468 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 05:05:07.606468 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 05:05:07.606468 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 05:05:07.606468 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 05:05:07.606468 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 05:05:07.606468 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 05:05:07.606468 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40ede213-15fc-4a6c-bec6-eef18aae6b87 could not be found. Jul 30 05:05:07.606468 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 05:05:07.606468 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 05:05:07.606468 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 05:05:07.606468 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:05:07.606468 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 05:05:07.606468 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 05:05:07.606468 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 05:05:07.606468 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 05:05:07.606468 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 05:05:07.607940 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 05:05:07.607940 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 30 05:05:07.607940 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 30 05:05:07.607940 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 30 05:05:07.607940 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 30 05:05:07.607940 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 05:05:07.607940 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 05:05:07.607940 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 05:05:07.607940 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 05:05:07.607940 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40ede213-15fc-4a6c-bec6-eef18aae6b87 could not be found. Jul 30 05:05:07.607940 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 05:05:07.607940 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 05:05:07.607940 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 05:05:07.607940 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:05:07.607940 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 05:05:07.607940 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 05:05:07.607940 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 05:05:07.607940 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 05:05:07.607940 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40ede213-15fc-4a6c-bec6-eef18aae6b87 could not be found. Jul 30 05:05:07.607940 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 05:05:07.609435 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-7364c48b-02ae-45eb-b803-43dbdedcea78 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Returning 404 to user: Instance 40ede213-15fc-4a6c-bec6-eef18aae6b87 could not be found. {{(pid=117886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 05:05:07.609435 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-7364c48b-02ae-45eb-b803-43dbdedcea78 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "DELETE /compute/v2.1/servers/40ede213-15fc-4a6c-bec6-eef18aae6b87" status: 404 len: 111 microversion: 2.1 time: 0.029332 Jul 30 05:05:07.609435 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 536/1023] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Jul 30 05:05:07 2022] DELETE /compute/v2.1/servers/40ede213-15fc-4a6c-bec6-eef18aae6b87 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 30 05:05:07.614329 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-6a1aa4ed-bf94-404d-88a6-259f72d02ac0 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:05:07.614976 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-6a1aa4ed-bf94-404d-88a6-259f72d02ac0 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: 40ede213-15fc-4a6c-bec6-eef18aae6b87] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:05:07.620753 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6a1aa4ed-bf94-404d-88a6-259f72d02ac0 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:07.621198 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6a1aa4ed-bf94-404d-88a6-259f72d02ac0 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:07.621953 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6a1aa4ed-bf94-404d-88a6-259f72d02ac0 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:07.622389 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6a1aa4ed-bf94-404d-88a6-259f72d02ac0 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:07.635543 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.wsgi [None req-6a1aa4ed-bf94-404d-88a6-259f72d02ac0 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] HTTP exception thrown: Instance 40ede213-15fc-4a6c-bec6-eef18aae6b87 could not be found. Jul 30 05:05:07.636980 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-6a1aa4ed-bf94-404d-88a6-259f72d02ac0 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Request method failure captured: Jul 30 05:05:07.636980 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: request: GET /compute/v2.1/servers/40ede213-15fc-4a6c-bec6-eef18aae6b87 HTTP/1.1 Jul 30 05:05:07.636980 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Accept: application/json Jul 30 05:05:07.636980 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Accept-Encoding: identity Jul 30 05:05:07.636980 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Connection: close Jul 30 05:05:07.636980 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Content-Length: 0 Jul 30 05:05:07.636980 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Content-Type: application/json Jul 30 05:05:07.636980 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Host: 10.222.0.20 Jul 30 05:05:07.636980 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Openstack-System-Scope: None Jul 30 05:05:07.636980 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: User-Agent: python-urllib3/1.26.10 Jul 30 05:05:07.636980 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Auth-Token: gAAAAABi5LpsOyvntIvMWRkdgHAWaqLWWQheVZGRSyU7m8d_2qr8zQQH3DOakkgVq23Q75nTB9odGI0F-DQpTcNmJESi7-iRiz2-Pz62AvInyIstK7nwhx7nj-QdimoRc10ZS0jEzNztVniYwiMWef1RbG0o7cJ-tzIv7p3eOvqZTnGZgHQkQhc Jul 30 05:05:07.636980 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Domain-Id: None Jul 30 05:05:07.636980 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Domain-Name: None Jul 30 05:05:07.636980 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Identity-Status: Confirmed Jul 30 05:05:07.636980 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Is-Admin-Project: True Jul 30 05:05:07.636980 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Project-Domain-Id: default Jul 30 05:05:07.636980 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Project-Domain-Name: Default Jul 30 05:05:07.636980 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Project-Id: e01500cb03c74d1082090cd1c1836169 Jul 30 05:05:07.636980 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Project-Name: tempest-AttachVolumeNegativeTest-490621097 Jul 30 05:05:07.636980 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Role: member,reader Jul 30 05:05:07.636980 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Roles: member,reader Jul 30 05:05:07.638523 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e01500cb03c74d1082090cd1c1836169"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e01500cb03c74d1082090cd1c1836169"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e01500cb03c74d1082090cd1c1836169"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e01500cb03c74d1082090cd1c1836169"}]}] Jul 30 05:05:07.638523 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Tenant: tempest-AttachVolumeNegativeTest-490621097 Jul 30 05:05:07.638523 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Tenant-Id: e01500cb03c74d1082090cd1c1836169 Jul 30 05:05:07.638523 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-490621097 Jul 30 05:05:07.638523 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User: tempest-AttachVolumeNegativeTest-490621097-project Jul 30 05:05:07.638523 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User-Domain-Id: default Jul 30 05:05:07.638523 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User-Domain-Name: Default Jul 30 05:05:07.638523 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User-Id: a8abb58f9c274e568d2d0fe3d4df11de Jul 30 05:05:07.638523 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User-Name: tempest-AttachVolumeNegativeTest-490621097-project Jul 30 05:05:07.638523 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: method: > Jul 30 05:05:07.638523 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: exception: Instance 40ede213-15fc-4a6c-bec6-eef18aae6b87 could not be found. Jul 30 05:05:07.638523 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: action_args: {'id': '40ede213-15fc-4a6c-bec6-eef18aae6b87'} Jul 30 05:05:07.642589 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 05:05:07.642589 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:05:07.642589 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 05:05:07.642589 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 05:05:07.642589 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 05:05:07.642589 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 05:05:07.642589 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 05:05:07.642589 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 05:05:07.642589 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 05:05:07.642589 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 05:05:07.642589 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40ede213-15fc-4a6c-bec6-eef18aae6b87 could not be found. Jul 30 05:05:07.642589 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 05:05:07.642589 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 05:05:07.642589 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 05:05:07.642589 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:05:07.642589 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 05:05:07.642589 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 05:05:07.642589 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 05:05:07.642589 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 05:05:07.642589 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 05:05:07.643822 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 05:05:07.643822 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 05:05:07.643822 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 05:05:07.643822 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 05:05:07.643822 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 05:05:07.643822 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 05:05:07.643822 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 05:05:07.643822 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40ede213-15fc-4a6c-bec6-eef18aae6b87 could not be found. Jul 30 05:05:07.643822 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 05:05:07.643822 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 05:05:07.643822 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 05:05:07.643822 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:05:07.643822 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 05:05:07.643822 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 05:05:07.643822 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 05:05:07.643822 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 05:05:07.643822 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40ede213-15fc-4a6c-bec6-eef18aae6b87 could not be found. Jul 30 05:05:07.643822 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 05:05:07.645444 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-6a1aa4ed-bf94-404d-88a6-259f72d02ac0 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Returning 404 to user: Instance 40ede213-15fc-4a6c-bec6-eef18aae6b87 could not be found. {{(pid=117886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 05:05:07.645444 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-6a1aa4ed-bf94-404d-88a6-259f72d02ac0 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/40ede213-15fc-4a6c-bec6-eef18aae6b87" status: 404 len: 111 microversion: 2.1 time: 0.028539 Jul 30 05:05:07.645444 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 537/1024] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:05:07 2022] GET /compute/v2.1/servers/40ede213-15fc-4a6c-bec6-eef18aae6b87 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 05:05:07.646880 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-992342e8-137c-4d28-894c-001c13591246 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42d3708ddfcc491cb366054dcd5f8881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abbb209e2c194596bb3e8b9a6880646e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:05:07.655718 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-992342e8-137c-4d28-894c-001c13591246 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] 10.222.0.20 "GET /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755" status: 200 len: 1755 microversion: 2.1 time: 0.174705 Jul 30 05:05:07.656294 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 488/1025] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:05:07 2022] GET /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755 => generated 1755 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:05:08.678326 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-d8d44c01-a2d8-42ec-802d-7ce03cdd15a0 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:05:08.678974 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-d8d44c01-a2d8-42ec-802d-7ce03cdd15a0 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] [instance: 0faad1c9-0b0d-44af-92cb-dd0acd61c755] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:05:08.685427 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d8d44c01-a2d8-42ec-802d-7ce03cdd15a0 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:08.685875 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d8d44c01-a2d8-42ec-802d-7ce03cdd15a0 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:08.686676 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d8d44c01-a2d8-42ec-802d-7ce03cdd15a0 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:08.687114 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d8d44c01-a2d8-42ec-802d-7ce03cdd15a0 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:08.779041 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-7c347b3c-b63c-4ec5-8fd4-ea206e125eb1 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:05:08.779551 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-7c347b3c-b63c-4ec5-8fd4-ea206e125eb1 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: 0a2aa4b1-2fd2-45e4-a058-71f0855e48c0] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:05:08.786309 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7c347b3c-b63c-4ec5-8fd4-ea206e125eb1 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:08.786723 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7c347b3c-b63c-4ec5-8fd4-ea206e125eb1 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:08.787494 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7c347b3c-b63c-4ec5-8fd4-ea206e125eb1 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:08.787935 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7c347b3c-b63c-4ec5-8fd4-ea206e125eb1 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:08.803710 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.wsgi [None req-7c347b3c-b63c-4ec5-8fd4-ea206e125eb1 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] HTTP exception thrown: Instance 0a2aa4b1-2fd2-45e4-a058-71f0855e48c0 could not be found. Jul 30 05:05:08.805389 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-7c347b3c-b63c-4ec5-8fd4-ea206e125eb1 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Request method failure captured: Jul 30 05:05:08.805389 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: request: DELETE /compute/v2.1/servers/0a2aa4b1-2fd2-45e4-a058-71f0855e48c0 HTTP/1.1 Jul 30 05:05:08.805389 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Accept: application/json Jul 30 05:05:08.805389 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Accept-Encoding: identity Jul 30 05:05:08.805389 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Connection: close Jul 30 05:05:08.805389 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Content-Length: 0 Jul 30 05:05:08.805389 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Content-Type: application/json Jul 30 05:05:08.805389 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Host: 10.222.0.20 Jul 30 05:05:08.805389 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Openstack-System-Scope: None Jul 30 05:05:08.805389 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: User-Agent: python-urllib3/1.26.10 Jul 30 05:05:08.805389 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Auth-Token: gAAAAABi5LpsOyvntIvMWRkdgHAWaqLWWQheVZGRSyU7m8d_2qr8zQQH3DOakkgVq23Q75nTB9odGI0F-DQpTcNmJESi7-iRiz2-Pz62AvInyIstK7nwhx7nj-QdimoRc10ZS0jEzNztVniYwiMWef1RbG0o7cJ-tzIv7p3eOvqZTnGZgHQkQhc Jul 30 05:05:08.805389 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Domain-Id: None Jul 30 05:05:08.805389 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Domain-Name: None Jul 30 05:05:08.805389 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Identity-Status: Confirmed Jul 30 05:05:08.805389 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Is-Admin-Project: True Jul 30 05:05:08.805389 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Domain-Id: default Jul 30 05:05:08.805389 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Domain-Name: Default Jul 30 05:05:08.805389 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Id: e01500cb03c74d1082090cd1c1836169 Jul 30 05:05:08.805389 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Name: tempest-AttachVolumeNegativeTest-490621097 Jul 30 05:05:08.805389 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Role: member,reader Jul 30 05:05:08.805389 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Roles: member,reader Jul 30 05:05:08.806842 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e01500cb03c74d1082090cd1c1836169"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e01500cb03c74d1082090cd1c1836169"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e01500cb03c74d1082090cd1c1836169"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e01500cb03c74d1082090cd1c1836169"}]}] Jul 30 05:05:08.806842 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Tenant: tempest-AttachVolumeNegativeTest-490621097 Jul 30 05:05:08.806842 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Tenant-Id: e01500cb03c74d1082090cd1c1836169 Jul 30 05:05:08.806842 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-490621097 Jul 30 05:05:08.806842 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User: tempest-AttachVolumeNegativeTest-490621097-project Jul 30 05:05:08.806842 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Domain-Id: default Jul 30 05:05:08.806842 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Domain-Name: Default Jul 30 05:05:08.806842 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Id: a8abb58f9c274e568d2d0fe3d4df11de Jul 30 05:05:08.806842 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Name: tempest-AttachVolumeNegativeTest-490621097-project Jul 30 05:05:08.806842 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: method: > Jul 30 05:05:08.806842 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: exception: Instance 0a2aa4b1-2fd2-45e4-a058-71f0855e48c0 could not be found. Jul 30 05:05:08.806842 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: action_args: {'id': '0a2aa4b1-2fd2-45e4-a058-71f0855e48c0'} Jul 30 05:05:08.807583 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 05:05:08.807583 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:05:08.807583 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 05:05:08.807583 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 05:05:08.807583 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 05:05:08.807583 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 05:05:08.807583 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 05:05:08.807583 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 05:05:08.807583 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 05:05:08.807583 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 05:05:08.807583 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a2aa4b1-2fd2-45e4-a058-71f0855e48c0 could not be found. Jul 30 05:05:08.807583 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:05:08.807583 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 05:05:08.807583 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:05:08.807583 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:05:08.807583 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 05:05:08.807583 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 05:05:08.807583 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 05:05:08.807583 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 05:05:08.807583 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 05:05:08.808825 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 05:05:08.808825 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 30 05:05:08.808825 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 30 05:05:08.808825 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 30 05:05:08.808825 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 30 05:05:08.808825 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 05:05:08.808825 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 05:05:08.808825 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 05:05:08.808825 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 05:05:08.808825 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a2aa4b1-2fd2-45e4-a058-71f0855e48c0 could not be found. Jul 30 05:05:08.808825 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:05:08.808825 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 05:05:08.808825 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:05:08.808825 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:05:08.808825 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 05:05:08.808825 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 05:05:08.808825 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 05:05:08.808825 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 05:05:08.808825 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a2aa4b1-2fd2-45e4-a058-71f0855e48c0 could not be found. Jul 30 05:05:08.808825 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:05:08.810092 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-7c347b3c-b63c-4ec5-8fd4-ea206e125eb1 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Returning 404 to user: Instance 0a2aa4b1-2fd2-45e4-a058-71f0855e48c0 could not be found. {{(pid=117885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 05:05:08.810092 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-7c347b3c-b63c-4ec5-8fd4-ea206e125eb1 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0a2aa4b1-2fd2-45e4-a058-71f0855e48c0" status: 404 len: 111 microversion: 2.1 time: 0.031586 Jul 30 05:05:08.810092 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 489/1026] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Jul 30 05:05:08 2022] DELETE /compute/v2.1/servers/0a2aa4b1-2fd2-45e4-a058-71f0855e48c0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 30 05:05:08.816019 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-0910b2e2-9a98-491b-a916-a74efc7184fc tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:05:08.816642 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-0910b2e2-9a98-491b-a916-a74efc7184fc tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: 0a2aa4b1-2fd2-45e4-a058-71f0855e48c0] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:05:08.822491 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0910b2e2-9a98-491b-a916-a74efc7184fc tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:08.822921 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0910b2e2-9a98-491b-a916-a74efc7184fc tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:08.823683 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0910b2e2-9a98-491b-a916-a74efc7184fc tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:08.824119 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0910b2e2-9a98-491b-a916-a74efc7184fc tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:08.837236 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.wsgi [None req-0910b2e2-9a98-491b-a916-a74efc7184fc tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] HTTP exception thrown: Instance 0a2aa4b1-2fd2-45e4-a058-71f0855e48c0 could not be found. Jul 30 05:05:08.838792 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-0910b2e2-9a98-491b-a916-a74efc7184fc tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Request method failure captured: Jul 30 05:05:08.838792 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: request: GET /compute/v2.1/servers/0a2aa4b1-2fd2-45e4-a058-71f0855e48c0 HTTP/1.1 Jul 30 05:05:08.838792 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Accept: application/json Jul 30 05:05:08.838792 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Accept-Encoding: identity Jul 30 05:05:08.838792 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Connection: close Jul 30 05:05:08.838792 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Content-Length: 0 Jul 30 05:05:08.838792 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Content-Type: application/json Jul 30 05:05:08.838792 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Host: 10.222.0.20 Jul 30 05:05:08.838792 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Openstack-System-Scope: None Jul 30 05:05:08.838792 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: User-Agent: python-urllib3/1.26.10 Jul 30 05:05:08.838792 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Auth-Token: gAAAAABi5LpsOyvntIvMWRkdgHAWaqLWWQheVZGRSyU7m8d_2qr8zQQH3DOakkgVq23Q75nTB9odGI0F-DQpTcNmJESi7-iRiz2-Pz62AvInyIstK7nwhx7nj-QdimoRc10ZS0jEzNztVniYwiMWef1RbG0o7cJ-tzIv7p3eOvqZTnGZgHQkQhc Jul 30 05:05:08.838792 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Domain-Id: None Jul 30 05:05:08.838792 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Domain-Name: None Jul 30 05:05:08.838792 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Identity-Status: Confirmed Jul 30 05:05:08.838792 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Is-Admin-Project: True Jul 30 05:05:08.838792 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Domain-Id: default Jul 30 05:05:08.838792 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Domain-Name: Default Jul 30 05:05:08.838792 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Id: e01500cb03c74d1082090cd1c1836169 Jul 30 05:05:08.838792 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Name: tempest-AttachVolumeNegativeTest-490621097 Jul 30 05:05:08.838792 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Role: member,reader Jul 30 05:05:08.838792 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Roles: member,reader Jul 30 05:05:08.840885 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e01500cb03c74d1082090cd1c1836169"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e01500cb03c74d1082090cd1c1836169"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e01500cb03c74d1082090cd1c1836169"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e01500cb03c74d1082090cd1c1836169"}]}] Jul 30 05:05:08.840885 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Tenant: tempest-AttachVolumeNegativeTest-490621097 Jul 30 05:05:08.840885 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Tenant-Id: e01500cb03c74d1082090cd1c1836169 Jul 30 05:05:08.840885 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-490621097 Jul 30 05:05:08.840885 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User: tempest-AttachVolumeNegativeTest-490621097-project Jul 30 05:05:08.840885 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Domain-Id: default Jul 30 05:05:08.840885 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Domain-Name: Default Jul 30 05:05:08.840885 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Id: a8abb58f9c274e568d2d0fe3d4df11de Jul 30 05:05:08.840885 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Name: tempest-AttachVolumeNegativeTest-490621097-project Jul 30 05:05:08.840885 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: method: > Jul 30 05:05:08.840885 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: exception: Instance 0a2aa4b1-2fd2-45e4-a058-71f0855e48c0 could not be found. Jul 30 05:05:08.840885 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: action_args: {'id': '0a2aa4b1-2fd2-45e4-a058-71f0855e48c0'} Jul 30 05:05:08.841849 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 05:05:08.841849 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:05:08.841849 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 05:05:08.841849 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 05:05:08.841849 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 05:05:08.841849 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 05:05:08.841849 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 05:05:08.841849 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 05:05:08.841849 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 05:05:08.841849 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 05:05:08.841849 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a2aa4b1-2fd2-45e4-a058-71f0855e48c0 could not be found. Jul 30 05:05:08.841849 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:05:08.841849 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 05:05:08.841849 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:05:08.841849 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:05:08.841849 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 05:05:08.841849 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 05:05:08.841849 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 05:05:08.841849 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 05:05:08.841849 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 05:05:08.843204 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 05:05:08.843204 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 05:05:08.843204 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 05:05:08.843204 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 05:05:08.843204 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 05:05:08.843204 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 05:05:08.843204 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 05:05:08.843204 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a2aa4b1-2fd2-45e4-a058-71f0855e48c0 could not be found. Jul 30 05:05:08.843204 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:05:08.843204 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 05:05:08.843204 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:05:08.843204 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:05:08.843204 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 05:05:08.843204 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 05:05:08.843204 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 05:05:08.843204 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 05:05:08.843204 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a2aa4b1-2fd2-45e4-a058-71f0855e48c0 could not be found. Jul 30 05:05:08.843204 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:05:08.844741 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-0910b2e2-9a98-491b-a916-a74efc7184fc tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Returning 404 to user: Instance 0a2aa4b1-2fd2-45e4-a058-71f0855e48c0 could not be found. {{(pid=117885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 05:05:08.844741 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-0910b2e2-9a98-491b-a916-a74efc7184fc tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/0a2aa4b1-2fd2-45e4-a058-71f0855e48c0" status: 404 len: 111 microversion: 2.1 time: 0.028555 Jul 30 05:05:08.844741 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 490/1027] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:05:08 2022] GET /compute/v2.1/servers/0a2aa4b1-2fd2-45e4-a058-71f0855e48c0 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 05:05:08.845522 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-d8d44c01-a2d8-42ec-802d-7ce03cdd15a0 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42d3708ddfcc491cb366054dcd5f8881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abbb209e2c194596bb3e8b9a6880646e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:05:08.848445 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-4fca7db4-7e36-4ac2-9260-5bcd95379e03 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:05:08.849126 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-4fca7db4-7e36-4ac2-9260-5bcd95379e03 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: 22fe5ad8-01f8-4d0a-bb24-7c23a427d328] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:05:08.852635 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-d8d44c01-a2d8-42ec-802d-7ce03cdd15a0 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] 10.222.0.20 "GET /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755" status: 200 len: 1755 microversion: 2.1 time: 0.178126 Jul 30 05:05:08.853224 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 538/1028] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:05:08 2022] GET /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755 => generated 1755 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:05:08.855846 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4fca7db4-7e36-4ac2-9260-5bcd95379e03 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:08.856297 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4fca7db4-7e36-4ac2-9260-5bcd95379e03 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:08.857065 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4fca7db4-7e36-4ac2-9260-5bcd95379e03 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:08.857502 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4fca7db4-7e36-4ac2-9260-5bcd95379e03 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:08.871929 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.wsgi [None req-4fca7db4-7e36-4ac2-9260-5bcd95379e03 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] HTTP exception thrown: Instance 22fe5ad8-01f8-4d0a-bb24-7c23a427d328 could not be found. Jul 30 05:05:08.873467 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-4fca7db4-7e36-4ac2-9260-5bcd95379e03 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Request method failure captured: Jul 30 05:05:08.873467 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: request: DELETE /compute/v2.1/servers/22fe5ad8-01f8-4d0a-bb24-7c23a427d328 HTTP/1.1 Jul 30 05:05:08.873467 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Accept: application/json Jul 30 05:05:08.873467 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Accept-Encoding: identity Jul 30 05:05:08.873467 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Connection: close Jul 30 05:05:08.873467 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Content-Length: 0 Jul 30 05:05:08.873467 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Content-Type: application/json Jul 30 05:05:08.873467 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Host: 10.222.0.20 Jul 30 05:05:08.873467 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Openstack-System-Scope: None Jul 30 05:05:08.873467 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: User-Agent: python-urllib3/1.26.10 Jul 30 05:05:08.873467 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Auth-Token: gAAAAABi5LpsOyvntIvMWRkdgHAWaqLWWQheVZGRSyU7m8d_2qr8zQQH3DOakkgVq23Q75nTB9odGI0F-DQpTcNmJESi7-iRiz2-Pz62AvInyIstK7nwhx7nj-QdimoRc10ZS0jEzNztVniYwiMWef1RbG0o7cJ-tzIv7p3eOvqZTnGZgHQkQhc Jul 30 05:05:08.873467 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Domain-Id: None Jul 30 05:05:08.873467 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Domain-Name: None Jul 30 05:05:08.873467 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Identity-Status: Confirmed Jul 30 05:05:08.873467 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Is-Admin-Project: True Jul 30 05:05:08.873467 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Domain-Id: default Jul 30 05:05:08.873467 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Domain-Name: Default Jul 30 05:05:08.873467 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Id: e01500cb03c74d1082090cd1c1836169 Jul 30 05:05:08.873467 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Name: tempest-AttachVolumeNegativeTest-490621097 Jul 30 05:05:08.873467 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Role: member,reader Jul 30 05:05:08.873467 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Roles: member,reader Jul 30 05:05:08.875105 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e01500cb03c74d1082090cd1c1836169"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e01500cb03c74d1082090cd1c1836169"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e01500cb03c74d1082090cd1c1836169"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e01500cb03c74d1082090cd1c1836169"}]}] Jul 30 05:05:08.875105 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Tenant: tempest-AttachVolumeNegativeTest-490621097 Jul 30 05:05:08.875105 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Tenant-Id: e01500cb03c74d1082090cd1c1836169 Jul 30 05:05:08.875105 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-490621097 Jul 30 05:05:08.875105 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User: tempest-AttachVolumeNegativeTest-490621097-project Jul 30 05:05:08.875105 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Domain-Id: default Jul 30 05:05:08.875105 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Domain-Name: Default Jul 30 05:05:08.875105 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Id: a8abb58f9c274e568d2d0fe3d4df11de Jul 30 05:05:08.875105 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Name: tempest-AttachVolumeNegativeTest-490621097-project Jul 30 05:05:08.875105 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: method: > Jul 30 05:05:08.875105 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: exception: Instance 22fe5ad8-01f8-4d0a-bb24-7c23a427d328 could not be found. Jul 30 05:05:08.875105 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: action_args: {'id': '22fe5ad8-01f8-4d0a-bb24-7c23a427d328'} Jul 30 05:05:08.876932 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 05:05:08.876932 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:05:08.876932 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 05:05:08.876932 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 05:05:08.876932 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 05:05:08.876932 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 05:05:08.876932 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 05:05:08.876932 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 05:05:08.876932 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 05:05:08.876932 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 05:05:08.876932 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22fe5ad8-01f8-4d0a-bb24-7c23a427d328 could not be found. Jul 30 05:05:08.876932 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:05:08.876932 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 05:05:08.876932 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:05:08.876932 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:05:08.876932 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 05:05:08.876932 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 05:05:08.876932 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 05:05:08.876932 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 05:05:08.876932 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 05:05:08.878401 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 05:05:08.878401 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 30 05:05:08.878401 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 30 05:05:08.878401 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 30 05:05:08.878401 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 30 05:05:08.878401 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 05:05:08.878401 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 05:05:08.878401 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 05:05:08.878401 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 05:05:08.878401 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22fe5ad8-01f8-4d0a-bb24-7c23a427d328 could not be found. Jul 30 05:05:08.878401 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:05:08.878401 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 05:05:08.878401 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:05:08.878401 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:05:08.878401 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 05:05:08.878401 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 05:05:08.878401 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 05:05:08.878401 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 05:05:08.878401 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22fe5ad8-01f8-4d0a-bb24-7c23a427d328 could not be found. Jul 30 05:05:08.878401 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:05:08.879984 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-4fca7db4-7e36-4ac2-9260-5bcd95379e03 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Returning 404 to user: Instance 22fe5ad8-01f8-4d0a-bb24-7c23a427d328 could not be found. {{(pid=117885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 05:05:08.879984 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-4fca7db4-7e36-4ac2-9260-5bcd95379e03 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "DELETE /compute/v2.1/servers/22fe5ad8-01f8-4d0a-bb24-7c23a427d328" status: 404 len: 111 microversion: 2.1 time: 0.030216 Jul 30 05:05:08.879984 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 491/1029] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Jul 30 05:05:08 2022] DELETE /compute/v2.1/servers/22fe5ad8-01f8-4d0a-bb24-7c23a427d328 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 30 05:05:08.884086 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-2a514c58-0b99-4e03-8e0e-4ee3a9341c63 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:05:08.884700 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-2a514c58-0b99-4e03-8e0e-4ee3a9341c63 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: 22fe5ad8-01f8-4d0a-bb24-7c23a427d328] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:05:08.890664 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2a514c58-0b99-4e03-8e0e-4ee3a9341c63 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:08.891876 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2a514c58-0b99-4e03-8e0e-4ee3a9341c63 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:08.892646 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2a514c58-0b99-4e03-8e0e-4ee3a9341c63 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:08.893084 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2a514c58-0b99-4e03-8e0e-4ee3a9341c63 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:08.906143 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.wsgi [None req-2a514c58-0b99-4e03-8e0e-4ee3a9341c63 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] HTTP exception thrown: Instance 22fe5ad8-01f8-4d0a-bb24-7c23a427d328 could not be found. Jul 30 05:05:08.908326 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-2a514c58-0b99-4e03-8e0e-4ee3a9341c63 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Request method failure captured: Jul 30 05:05:08.908326 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: request: GET /compute/v2.1/servers/22fe5ad8-01f8-4d0a-bb24-7c23a427d328 HTTP/1.1 Jul 30 05:05:08.908326 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Accept: application/json Jul 30 05:05:08.908326 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Accept-Encoding: identity Jul 30 05:05:08.908326 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Connection: close Jul 30 05:05:08.908326 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Content-Length: 0 Jul 30 05:05:08.908326 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Content-Type: application/json Jul 30 05:05:08.908326 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Host: 10.222.0.20 Jul 30 05:05:08.908326 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Openstack-System-Scope: None Jul 30 05:05:08.908326 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: User-Agent: python-urllib3/1.26.10 Jul 30 05:05:08.908326 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Auth-Token: gAAAAABi5LpsOyvntIvMWRkdgHAWaqLWWQheVZGRSyU7m8d_2qr8zQQH3DOakkgVq23Q75nTB9odGI0F-DQpTcNmJESi7-iRiz2-Pz62AvInyIstK7nwhx7nj-QdimoRc10ZS0jEzNztVniYwiMWef1RbG0o7cJ-tzIv7p3eOvqZTnGZgHQkQhc Jul 30 05:05:08.908326 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Domain-Id: None Jul 30 05:05:08.908326 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Domain-Name: None Jul 30 05:05:08.908326 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Identity-Status: Confirmed Jul 30 05:05:08.908326 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Is-Admin-Project: True Jul 30 05:05:08.908326 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Project-Domain-Id: default Jul 30 05:05:08.908326 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Project-Domain-Name: Default Jul 30 05:05:08.908326 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Project-Id: e01500cb03c74d1082090cd1c1836169 Jul 30 05:05:08.908326 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Project-Name: tempest-AttachVolumeNegativeTest-490621097 Jul 30 05:05:08.908326 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Role: member,reader Jul 30 05:05:08.908326 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Roles: member,reader Jul 30 05:05:08.909936 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e01500cb03c74d1082090cd1c1836169"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e01500cb03c74d1082090cd1c1836169"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e01500cb03c74d1082090cd1c1836169"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e01500cb03c74d1082090cd1c1836169"}]}] Jul 30 05:05:08.909936 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Tenant: tempest-AttachVolumeNegativeTest-490621097 Jul 30 05:05:08.909936 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Tenant-Id: e01500cb03c74d1082090cd1c1836169 Jul 30 05:05:08.909936 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-490621097 Jul 30 05:05:08.909936 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User: tempest-AttachVolumeNegativeTest-490621097-project Jul 30 05:05:08.909936 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User-Domain-Id: default Jul 30 05:05:08.909936 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User-Domain-Name: Default Jul 30 05:05:08.909936 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User-Id: a8abb58f9c274e568d2d0fe3d4df11de Jul 30 05:05:08.909936 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User-Name: tempest-AttachVolumeNegativeTest-490621097-project Jul 30 05:05:08.909936 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: method: > Jul 30 05:05:08.909936 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: exception: Instance 22fe5ad8-01f8-4d0a-bb24-7c23a427d328 could not be found. Jul 30 05:05:08.909936 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: action_args: {'id': '22fe5ad8-01f8-4d0a-bb24-7c23a427d328'} Jul 30 05:05:08.910871 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 05:05:08.910871 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:05:08.910871 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 05:05:08.910871 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 05:05:08.910871 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 05:05:08.910871 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 05:05:08.910871 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 05:05:08.910871 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 05:05:08.910871 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 05:05:08.910871 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 05:05:08.910871 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22fe5ad8-01f8-4d0a-bb24-7c23a427d328 could not be found. Jul 30 05:05:08.910871 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 05:05:08.910871 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 05:05:08.910871 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 05:05:08.910871 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:05:08.910871 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 05:05:08.910871 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 05:05:08.910871 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 05:05:08.910871 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 05:05:08.910871 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 05:05:08.912378 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 05:05:08.912378 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 05:05:08.912378 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 05:05:08.912378 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 05:05:08.912378 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 05:05:08.912378 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 05:05:08.912378 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 05:05:08.912378 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22fe5ad8-01f8-4d0a-bb24-7c23a427d328 could not be found. Jul 30 05:05:08.912378 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 05:05:08.912378 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 05:05:08.912378 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 05:05:08.912378 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:05:08.912378 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 05:05:08.912378 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 05:05:08.912378 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 05:05:08.912378 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 05:05:08.912378 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22fe5ad8-01f8-4d0a-bb24-7c23a427d328 could not be found. Jul 30 05:05:08.912378 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 05:05:08.913961 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-2a514c58-0b99-4e03-8e0e-4ee3a9341c63 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Returning 404 to user: Instance 22fe5ad8-01f8-4d0a-bb24-7c23a427d328 could not be found. {{(pid=117886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 05:05:08.913961 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-2a514c58-0b99-4e03-8e0e-4ee3a9341c63 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/22fe5ad8-01f8-4d0a-bb24-7c23a427d328" status: 404 len: 111 microversion: 2.1 time: 0.029382 Jul 30 05:05:08.913961 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 539/1030] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:05:08 2022] GET /compute/v2.1/servers/22fe5ad8-01f8-4d0a-bb24-7c23a427d328 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 30 05:05:09.874930 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-fc08074c-6024-4098-940a-aacf9ad4dd00 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:05:09.875551 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-fc08074c-6024-4098-940a-aacf9ad4dd00 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] [instance: 0faad1c9-0b0d-44af-92cb-dd0acd61c755] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:05:09.882511 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-fc08074c-6024-4098-940a-aacf9ad4dd00 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:09.882965 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-fc08074c-6024-4098-940a-aacf9ad4dd00 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:09.883755 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-fc08074c-6024-4098-940a-aacf9ad4dd00 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:09.884197 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-fc08074c-6024-4098-940a-aacf9ad4dd00 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:10.027413 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-fc08074c-6024-4098-940a-aacf9ad4dd00 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42d3708ddfcc491cb366054dcd5f8881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abbb209e2c194596bb3e8b9a6880646e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:05:10.036092 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-fc08074c-6024-4098-940a-aacf9ad4dd00 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] 10.222.0.20 "GET /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755" status: 200 len: 1755 microversion: 2.1 time: 0.165051 Jul 30 05:05:10.036668 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 492/1031] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:05:09 2022] GET /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755 => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:05:10.051418 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-47f31674-0150-440e-a9c9-6cc7f9455ef9 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:05:10.051981 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-47f31674-0150-440e-a9c9-6cc7f9455ef9 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: f27c16ec-7d74-4a2a-9b40-c95455fa8aff] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:05:10.058429 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-47f31674-0150-440e-a9c9-6cc7f9455ef9 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:10.058911 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-47f31674-0150-440e-a9c9-6cc7f9455ef9 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:10.059676 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-47f31674-0150-440e-a9c9-6cc7f9455ef9 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:10.060110 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-47f31674-0150-440e-a9c9-6cc7f9455ef9 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:10.073612 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.wsgi [None req-47f31674-0150-440e-a9c9-6cc7f9455ef9 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] HTTP exception thrown: Instance f27c16ec-7d74-4a2a-9b40-c95455fa8aff could not be found. Jul 30 05:05:10.075154 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-47f31674-0150-440e-a9c9-6cc7f9455ef9 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Request method failure captured: Jul 30 05:05:10.075154 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: request: DELETE /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff HTTP/1.1 Jul 30 05:05:10.075154 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Accept: application/json Jul 30 05:05:10.075154 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Accept-Encoding: identity Jul 30 05:05:10.075154 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Connection: close Jul 30 05:05:10.075154 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Content-Length: 0 Jul 30 05:05:10.075154 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Content-Type: application/json Jul 30 05:05:10.075154 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Host: 10.222.0.20 Jul 30 05:05:10.075154 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Openstack-System-Scope: None Jul 30 05:05:10.075154 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: User-Agent: python-urllib3/1.26.10 Jul 30 05:05:10.075154 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Auth-Token: gAAAAABi5LpsOyvntIvMWRkdgHAWaqLWWQheVZGRSyU7m8d_2qr8zQQH3DOakkgVq23Q75nTB9odGI0F-DQpTcNmJESi7-iRiz2-Pz62AvInyIstK7nwhx7nj-QdimoRc10ZS0jEzNztVniYwiMWef1RbG0o7cJ-tzIv7p3eOvqZTnGZgHQkQhc Jul 30 05:05:10.075154 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Domain-Id: None Jul 30 05:05:10.075154 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Domain-Name: None Jul 30 05:05:10.075154 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Identity-Status: Confirmed Jul 30 05:05:10.075154 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Is-Admin-Project: True Jul 30 05:05:10.075154 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Project-Domain-Id: default Jul 30 05:05:10.075154 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Project-Domain-Name: Default Jul 30 05:05:10.075154 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Project-Id: e01500cb03c74d1082090cd1c1836169 Jul 30 05:05:10.075154 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Project-Name: tempest-AttachVolumeNegativeTest-490621097 Jul 30 05:05:10.075154 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Role: member,reader Jul 30 05:05:10.075154 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Roles: member,reader Jul 30 05:05:10.076803 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e01500cb03c74d1082090cd1c1836169"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e01500cb03c74d1082090cd1c1836169"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e01500cb03c74d1082090cd1c1836169"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e01500cb03c74d1082090cd1c1836169"}]}] Jul 30 05:05:10.076803 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Tenant: tempest-AttachVolumeNegativeTest-490621097 Jul 30 05:05:10.076803 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Tenant-Id: e01500cb03c74d1082090cd1c1836169 Jul 30 05:05:10.076803 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-490621097 Jul 30 05:05:10.076803 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User: tempest-AttachVolumeNegativeTest-490621097-project Jul 30 05:05:10.076803 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User-Domain-Id: default Jul 30 05:05:10.076803 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User-Domain-Name: Default Jul 30 05:05:10.076803 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User-Id: a8abb58f9c274e568d2d0fe3d4df11de Jul 30 05:05:10.076803 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User-Name: tempest-AttachVolumeNegativeTest-490621097-project Jul 30 05:05:10.076803 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: method: > Jul 30 05:05:10.076803 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: exception: Instance f27c16ec-7d74-4a2a-9b40-c95455fa8aff could not be found. Jul 30 05:05:10.076803 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: action_args: {'id': 'f27c16ec-7d74-4a2a-9b40-c95455fa8aff'} Jul 30 05:05:10.077628 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 05:05:10.077628 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:05:10.077628 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 05:05:10.077628 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 05:05:10.077628 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 05:05:10.077628 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 05:05:10.077628 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 05:05:10.077628 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 05:05:10.077628 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 05:05:10.077628 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 05:05:10.077628 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f27c16ec-7d74-4a2a-9b40-c95455fa8aff could not be found. Jul 30 05:05:10.077628 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 05:05:10.077628 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 05:05:10.077628 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 05:05:10.077628 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:05:10.077628 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 05:05:10.077628 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 05:05:10.077628 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 05:05:10.077628 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 05:05:10.077628 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 05:05:10.078902 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 05:05:10.078902 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 30 05:05:10.078902 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 30 05:05:10.078902 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 30 05:05:10.078902 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 30 05:05:10.078902 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 05:05:10.078902 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 05:05:10.078902 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 05:05:10.078902 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 05:05:10.078902 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f27c16ec-7d74-4a2a-9b40-c95455fa8aff could not be found. Jul 30 05:05:10.078902 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 05:05:10.078902 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 05:05:10.078902 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 05:05:10.078902 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:05:10.078902 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 05:05:10.078902 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 05:05:10.078902 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 05:05:10.078902 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 05:05:10.078902 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f27c16ec-7d74-4a2a-9b40-c95455fa8aff could not be found. Jul 30 05:05:10.078902 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 05:05:10.080847 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-47f31674-0150-440e-a9c9-6cc7f9455ef9 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Returning 404 to user: Instance f27c16ec-7d74-4a2a-9b40-c95455fa8aff could not be found. {{(pid=117886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 05:05:10.080847 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-47f31674-0150-440e-a9c9-6cc7f9455ef9 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff" status: 404 len: 111 microversion: 2.1 time: 0.029554 Jul 30 05:05:10.080847 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 540/1032] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Jul 30 05:05:10 2022] DELETE /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 30 05:05:10.085427 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-bf400509-85c6-41da-ac2e-90ca54599c43 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:05:10.086042 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-bf400509-85c6-41da-ac2e-90ca54599c43 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] [instance: f27c16ec-7d74-4a2a-9b40-c95455fa8aff] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:05:10.092043 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-bf400509-85c6-41da-ac2e-90ca54599c43 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:10.092494 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-bf400509-85c6-41da-ac2e-90ca54599c43 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:10.093254 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-bf400509-85c6-41da-ac2e-90ca54599c43 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:10.093692 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-bf400509-85c6-41da-ac2e-90ca54599c43 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:10.107760 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.wsgi [None req-bf400509-85c6-41da-ac2e-90ca54599c43 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] HTTP exception thrown: Instance f27c16ec-7d74-4a2a-9b40-c95455fa8aff could not be found. Jul 30 05:05:10.109260 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-bf400509-85c6-41da-ac2e-90ca54599c43 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Request method failure captured: Jul 30 05:05:10.109260 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: request: GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff HTTP/1.1 Jul 30 05:05:10.109260 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Accept: application/json Jul 30 05:05:10.109260 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Accept-Encoding: identity Jul 30 05:05:10.109260 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Connection: close Jul 30 05:05:10.109260 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Content-Length: 0 Jul 30 05:05:10.109260 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Content-Type: application/json Jul 30 05:05:10.109260 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Host: 10.222.0.20 Jul 30 05:05:10.109260 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Openstack-System-Scope: None Jul 30 05:05:10.109260 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: User-Agent: python-urllib3/1.26.10 Jul 30 05:05:10.109260 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Auth-Token: gAAAAABi5LpsOyvntIvMWRkdgHAWaqLWWQheVZGRSyU7m8d_2qr8zQQH3DOakkgVq23Q75nTB9odGI0F-DQpTcNmJESi7-iRiz2-Pz62AvInyIstK7nwhx7nj-QdimoRc10ZS0jEzNztVniYwiMWef1RbG0o7cJ-tzIv7p3eOvqZTnGZgHQkQhc Jul 30 05:05:10.109260 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Domain-Id: None Jul 30 05:05:10.109260 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Domain-Name: None Jul 30 05:05:10.109260 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Identity-Status: Confirmed Jul 30 05:05:10.109260 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Is-Admin-Project: True Jul 30 05:05:10.109260 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Domain-Id: default Jul 30 05:05:10.109260 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Domain-Name: Default Jul 30 05:05:10.109260 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Id: e01500cb03c74d1082090cd1c1836169 Jul 30 05:05:10.109260 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Name: tempest-AttachVolumeNegativeTest-490621097 Jul 30 05:05:10.109260 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Role: member,reader Jul 30 05:05:10.109260 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Roles: member,reader Jul 30 05:05:10.110937 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e01500cb03c74d1082090cd1c1836169"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e01500cb03c74d1082090cd1c1836169"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e01500cb03c74d1082090cd1c1836169"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e01500cb03c74d1082090cd1c1836169"}]}] Jul 30 05:05:10.110937 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Tenant: tempest-AttachVolumeNegativeTest-490621097 Jul 30 05:05:10.110937 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Tenant-Id: e01500cb03c74d1082090cd1c1836169 Jul 30 05:05:10.110937 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-490621097 Jul 30 05:05:10.110937 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User: tempest-AttachVolumeNegativeTest-490621097-project Jul 30 05:05:10.110937 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Domain-Id: default Jul 30 05:05:10.110937 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Domain-Name: Default Jul 30 05:05:10.110937 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Id: a8abb58f9c274e568d2d0fe3d4df11de Jul 30 05:05:10.110937 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Name: tempest-AttachVolumeNegativeTest-490621097-project Jul 30 05:05:10.110937 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: method: > Jul 30 05:05:10.110937 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: exception: Instance f27c16ec-7d74-4a2a-9b40-c95455fa8aff could not be found. Jul 30 05:05:10.110937 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: action_args: {'id': 'f27c16ec-7d74-4a2a-9b40-c95455fa8aff'} Jul 30 05:05:10.111878 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 05:05:10.111878 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:05:10.111878 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 05:05:10.111878 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 05:05:10.111878 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 05:05:10.111878 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 05:05:10.111878 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 05:05:10.111878 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 05:05:10.111878 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 05:05:10.111878 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 05:05:10.111878 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f27c16ec-7d74-4a2a-9b40-c95455fa8aff could not be found. Jul 30 05:05:10.111878 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:05:10.111878 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 05:05:10.111878 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:05:10.111878 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:05:10.111878 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 05:05:10.111878 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 05:05:10.111878 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 05:05:10.111878 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 05:05:10.111878 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 05:05:10.113356 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 05:05:10.113356 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 05:05:10.113356 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 05:05:10.113356 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 05:05:10.113356 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 05:05:10.113356 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 05:05:10.113356 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 05:05:10.113356 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f27c16ec-7d74-4a2a-9b40-c95455fa8aff could not be found. Jul 30 05:05:10.113356 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:05:10.113356 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 05:05:10.113356 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:05:10.113356 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:05:10.113356 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 05:05:10.113356 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 05:05:10.113356 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 05:05:10.113356 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 05:05:10.113356 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f27c16ec-7d74-4a2a-9b40-c95455fa8aff could not be found. Jul 30 05:05:10.113356 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:05:10.114719 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-bf400509-85c6-41da-ac2e-90ca54599c43 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] Returning 404 to user: Instance f27c16ec-7d74-4a2a-9b40-c95455fa8aff could not be found. {{(pid=117885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 05:05:10.114719 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-bf400509-85c6-41da-ac2e-90ca54599c43 tempest-AttachVolumeNegativeTest-490621097 tempest-AttachVolumeNegativeTest-490621097-project] 10.222.0.20 "GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff" status: 404 len: 111 microversion: 2.1 time: 0.029004 Jul 30 05:05:10.114719 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 493/1033] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:05:10 2022] GET /compute/v2.1/servers/f27c16ec-7d74-4a2a-9b40-c95455fa8aff => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 05:05:11.061751 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-41cfaf50-0e44-4663-8668-b12f8fe5ae53 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:05:11.062371 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-41cfaf50-0e44-4663-8668-b12f8fe5ae53 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] [instance: 0faad1c9-0b0d-44af-92cb-dd0acd61c755] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:05:11.070670 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-41cfaf50-0e44-4663-8668-b12f8fe5ae53 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:11.071037 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-41cfaf50-0e44-4663-8668-b12f8fe5ae53 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:11.071820 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-41cfaf50-0e44-4663-8668-b12f8fe5ae53 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:11.072256 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-41cfaf50-0e44-4663-8668-b12f8fe5ae53 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:11.243346 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-41cfaf50-0e44-4663-8668-b12f8fe5ae53 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42d3708ddfcc491cb366054dcd5f8881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abbb209e2c194596bb3e8b9a6880646e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:05:11.252550 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-41cfaf50-0e44-4663-8668-b12f8fe5ae53 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] 10.222.0.20 "GET /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755" status: 200 len: 1758 microversion: 2.1 time: 0.194563 Jul 30 05:05:11.263147 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 541/1034] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:05:11 2022] GET /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755 => generated 1758 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:05:16.034230 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-edd50586-4434-40ee-822e-6328442771c0 tempest-VolumesTestJSON-56154366 tempest-VolumesTestJSON-56154366-project] Calling method '.version_select at 0x7f2daf753af0>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:05:16.083217 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-edd50586-4434-40ee-822e-6328442771c0 tempest-VolumesTestJSON-56154366 tempest-VolumesTestJSON-56154366-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/b9cc362f-3c3e-43c9-86fd-7a6d9f299a3b" status: 200 len: 349 microversion: 2.1 time: 0.052825 Jul 30 05:05:16.083835 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 494/1035] 10.222.0.20 () {58 vars in 1245 bytes} [Sat Jul 30 05:05:16 2022] GET /compute/v2.1/os-volumes/b9cc362f-3c3e-43c9-86fd-7a6d9f299a3b => generated 349 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 05:05:17.416301 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-b751a87a-63e7-4829-92cc-1a7b0c5360ba tempest-VolumesTestJSON-56154366 tempest-VolumesTestJSON-56154366-project] Calling method '.version_select at 0x7f2db4034790>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:05:17.463620 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-b751a87a-63e7-4829-92cc-1a7b0c5360ba tempest-VolumesTestJSON-56154366 tempest-VolumesTestJSON-56154366-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/caa2ef90-aaa5-46d4-a76d-9cc1d543b9ee" status: 200 len: 350 microversion: 2.1 time: 0.051114 Jul 30 05:05:17.464197 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 542/1036] 10.222.0.20 () {58 vars in 1245 bytes} [Sat Jul 30 05:05:17 2022] GET /compute/v2.1/os-volumes/caa2ef90-aaa5-46d4-a76d-9cc1d543b9ee => generated 350 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 05:05:18.789731 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-f8f024bb-c012-4e55-b99f-24e4acf2f7c5 tempest-VolumesTestJSON-56154366 tempest-VolumesTestJSON-56154366-project] Calling method '.version_select at 0x7f2db404e5e0>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:05:18.838396 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-f8f024bb-c012-4e55-b99f-24e4acf2f7c5 tempest-VolumesTestJSON-56154366 tempest-VolumesTestJSON-56154366-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/d6b186f5-9395-4445-bf73-7d238767e2bb" status: 200 len: 350 microversion: 2.1 time: 0.052842 Jul 30 05:05:18.839211 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 495/1037] 10.222.0.20 () {58 vars in 1245 bytes} [Sat Jul 30 05:05:18 2022] GET /compute/v2.1/os-volumes/d6b186f5-9395-4445-bf73-7d238767e2bb => generated 350 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 05:05:18.852361 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-e9daca96-a7cf-44de-90a1-d70d14d3c804 tempest-VolumesTestJSON-56154366 tempest-VolumesTestJSON-56154366-project] Calling method '.version_select at 0x7f2daf6aec10>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:05:18.933143 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-e9daca96-a7cf-44de-90a1-d70d14d3c804 tempest-VolumesTestJSON-56154366 tempest-VolumesTestJSON-56154366-project] 10.222.0.20 "GET /compute/v2.1/os-volumes" status: 200 len: 1032 microversion: 2.1 time: 0.085154 Jul 30 05:05:18.933713 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 543/1038] 10.222.0.20 () {58 vars in 1134 bytes} [Sat Jul 30 05:05:18 2022] GET /compute/v2.1/os-volumes => generated 1032 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:05:18.947340 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-e880215f-fa56-4097-88a6-c9f49d8c69a9 tempest-VolumesTestJSON-56154366 tempest-VolumesTestJSON-56154366-project] Calling method '.version_select at 0x7f2db404e3a0>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:05:19.031700 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-e880215f-fa56-4097-88a6-c9f49d8c69a9 tempest-VolumesTestJSON-56154366 tempest-VolumesTestJSON-56154366-project] 10.222.0.20 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.088024 Jul 30 05:05:19.032265 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 496/1039] 10.222.0.20 () {58 vars in 1149 bytes} [Sat Jul 30 05:05:18 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 05:05:19.046555 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-cc415bf4-cb10-4e3f-903b-4f15ed9f21c7 tempest-VolumesTestJSON-56154366 tempest-VolumesTestJSON-56154366-project] Calling method '.version_select at 0x7f2daf6e91f0>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:05:19.127840 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-cc415bf4-cb10-4e3f-903b-4f15ed9f21c7 tempest-VolumesTestJSON-56154366 tempest-VolumesTestJSON-56154366-project] 10.222.0.20 "GET /compute/v2.1/os-volumes" status: 200 len: 1032 microversion: 2.1 time: 0.085237 Jul 30 05:05:19.128394 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 544/1040] 10.222.0.20 () {58 vars in 1134 bytes} [Sat Jul 30 05:05:19 2022] GET /compute/v2.1/os-volumes => generated 1032 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:05:19.140840 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-89ce7581-d8b6-4509-bf0e-b267de54adea tempest-VolumesTestJSON-56154366 tempest-VolumesTestJSON-56154366-project] Calling method '.version_select at 0x7f2db42a5a60>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:05:19.223330 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-89ce7581-d8b6-4509-bf0e-b267de54adea tempest-VolumesTestJSON-56154366 tempest-VolumesTestJSON-56154366-project] 10.222.0.20 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.086177 Jul 30 05:05:19.223893 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 497/1041] 10.222.0.20 () {58 vars in 1167 bytes} [Sat Jul 30 05:05:19 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 05:05:19.237418 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-fd0907f9-ca70-4696-b84a-46c95369cadd tempest-VolumesTestJSON-56154366 tempest-VolumesTestJSON-56154366-project] Calling method '.version_select at 0x7f2daf6e9820>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:05:19.320403 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-fd0907f9-ca70-4696-b84a-46c95369cadd tempest-VolumesTestJSON-56154366 tempest-VolumesTestJSON-56154366-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.087276 Jul 30 05:05:19.321098 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 545/1042] 10.222.0.20 () {58 vars in 1170 bytes} [Sat Jul 30 05:05:19 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 05:05:19.333875 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-61fbfd63-9b7f-47f5-8d66-ae19b51da4e0 tempest-VolumesTestJSON-56154366 tempest-VolumesTestJSON-56154366-project] Calling method '.version_select at 0x7f2daf75a5e0>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:05:19.416347 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-61fbfd63-9b7f-47f5-8d66-ae19b51da4e0 tempest-VolumesTestJSON-56154366 tempest-VolumesTestJSON-56154366-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1032 microversion: 2.1 time: 0.086179 Jul 30 05:05:19.416917 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 498/1043] 10.222.0.20 () {58 vars in 1155 bytes} [Sat Jul 30 05:05:19 2022] GET /compute/v2.1/os-volumes/detail => generated 1032 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:05:19.431060 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-7203c8bf-3099-4e38-8b50-c378d54c159b tempest-VolumesTestJSON-56154366 tempest-VolumesTestJSON-56154366-project] Calling method '.version_select at 0x7f2daf6fbaf0>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:05:19.514036 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-7203c8bf-3099-4e38-8b50-c378d54c159b tempest-VolumesTestJSON-56154366 tempest-VolumesTestJSON-56154366-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.086644 Jul 30 05:05:19.514749 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 546/1044] 10.222.0.20 () {58 vars in 1188 bytes} [Sat Jul 30 05:05:19 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 05:05:19.528055 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-20137275-27cd-458d-8e8b-bbba2274f071 tempest-VolumesTestJSON-56154366 tempest-VolumesTestJSON-56154366-project] Calling method '.version_select at 0x7f2db404e670>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:05:19.609569 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-20137275-27cd-458d-8e8b-bbba2274f071 tempest-VolumesTestJSON-56154366 tempest-VolumesTestJSON-56154366-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1032 microversion: 2.1 time: 0.085252 Jul 30 05:05:19.610174 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 499/1045] 10.222.0.20 () {58 vars in 1155 bytes} [Sat Jul 30 05:05:19 2022] GET /compute/v2.1/os-volumes/detail => generated 1032 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:05:20.890028 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-9910b2f0-d97e-4cbe-9523-b7bc78c35213 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:05:20.890828 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-9910b2f0-d97e-4cbe-9523-b7bc78c35213 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] [instance: 99b497c8-e641-428a-94b6-86c21af5844f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:05:20.892673 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_api:SELECT=38,nova_api:DELETE=1 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:05:20.893417 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell1:SELECT=30 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:05:20.894579 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:05:20.898355 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-8688941a-c39b-4d94-a38d-e804aa8144d0 req-7a422676-1f17-4bdd-ac2d-e8635c9e2a74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99b497c8-e641-428a-94b6-86c21af5844f", "tag": "1a76ab0f-eada-4891-8b4c-b2af44036eb1"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:05:20.899913 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9910b2f0-d97e-4cbe-9523-b7bc78c35213 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:20.900464 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9910b2f0-d97e-4cbe-9523-b7bc78c35213 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:20.901373 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9910b2f0-d97e-4cbe-9523-b7bc78c35213 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:20.901941 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9910b2f0-d97e-4cbe-9523-b7bc78c35213 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:20.911481 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-8688941a-c39b-4d94-a38d-e804aa8144d0 req-7a422676-1f17-4bdd-ac2d-e8635c9e2a74 service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:20.911934 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-8688941a-c39b-4d94-a38d-e804aa8144d0 req-7a422676-1f17-4bdd-ac2d-e8635c9e2a74 service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:20.928522 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-8688941a-c39b-4d94-a38d-e804aa8144d0 req-7a422676-1f17-4bdd-ac2d-e8635c9e2a74 service nova] Creating event network-changed:1a76ab0f-eada-4891-8b4c-b2af44036eb1 for instance 99b497c8-e641-428a-94b6-86c21af5844f on hv-cinder-85127 Jul 30 05:05:20.930689 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-9910b2f0-d97e-4cbe-9523-b7bc78c35213 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] [instance: 99b497c8-e641-428a-94b6-86c21af5844f] Going to try to terminate instance {{(pid=117886) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 05:05:20.933879 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-8688941a-c39b-4d94-a38d-e804aa8144d0 req-7a422676-1f17-4bdd-ac2d-e8635c9e2a74 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042725 Jul 30 05:05:20.934727 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 500/1046] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Jul 30 05:05:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 05:05:21.031373 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-9910b2f0-d97e-4cbe-9523-b7bc78c35213 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] 10.222.0.20 "DELETE /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f" status: 204 len: 0 microversion: 2.1 time: 0.145614 Jul 30 05:05:21.032258 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 547/1047] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Jul 30 05:05:20 2022] DELETE /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 30 05:05:21.041007 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-50e58503-04f4-4809-a4c2-27c02f6f408f tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:05:21.041935 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-50e58503-04f4-4809-a4c2-27c02f6f408f tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] [instance: 99b497c8-e641-428a-94b6-86c21af5844f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:05:21.048498 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-50e58503-04f4-4809-a4c2-27c02f6f408f tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:21.049100 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-50e58503-04f4-4809-a4c2-27c02f6f408f tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:21.049967 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-50e58503-04f4-4809-a4c2-27c02f6f408f tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:21.050653 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-50e58503-04f4-4809-a4c2-27c02f6f408f tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:21.212610 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-50e58503-04f4-4809-a4c2-27c02f6f408f tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a98edf8e5a4a22b3ae7d041b582b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76df23454a3c4a9bb4f61b044ed5a426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:05:21.220988 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-50e58503-04f4-4809-a4c2-27c02f6f408f tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] 10.222.0.20 "GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f" status: 200 len: 1563 microversion: 2.1 time: 0.183988 Jul 30 05:05:21.221643 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 501/1048] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:05:21 2022] GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f => generated 1563 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 05:05:22.243302 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-1ad8f09e-7fd8-4d89-9ffe-5ee64b7090f9 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:05:22.243998 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-1ad8f09e-7fd8-4d89-9ffe-5ee64b7090f9 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] [instance: 99b497c8-e641-428a-94b6-86c21af5844f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:05:22.250286 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1ad8f09e-7fd8-4d89-9ffe-5ee64b7090f9 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:22.250840 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1ad8f09e-7fd8-4d89-9ffe-5ee64b7090f9 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:22.252267 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1ad8f09e-7fd8-4d89-9ffe-5ee64b7090f9 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:22.252668 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1ad8f09e-7fd8-4d89-9ffe-5ee64b7090f9 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:22.392730 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-1ad8f09e-7fd8-4d89-9ffe-5ee64b7090f9 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a98edf8e5a4a22b3ae7d041b582b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76df23454a3c4a9bb4f61b044ed5a426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:05:22.400326 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-1ad8f09e-7fd8-4d89-9ffe-5ee64b7090f9 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] 10.222.0.20 "GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f" status: 200 len: 1563 microversion: 2.1 time: 0.161319 Jul 30 05:05:22.400882 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 548/1049] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:05:22 2022] GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f => generated 1563 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:05:23.423927 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-ebbccdf9-a704-47db-94ab-faaa8971135f tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:05:23.424831 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-ebbccdf9-a704-47db-94ab-faaa8971135f tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] [instance: 99b497c8-e641-428a-94b6-86c21af5844f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:05:23.431767 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ebbccdf9-a704-47db-94ab-faaa8971135f tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:23.432650 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ebbccdf9-a704-47db-94ab-faaa8971135f tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:23.433563 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ebbccdf9-a704-47db-94ab-faaa8971135f tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:23.434098 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-ebbccdf9-a704-47db-94ab-faaa8971135f tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:23.560282 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-ebbccdf9-a704-47db-94ab-faaa8971135f tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a98edf8e5a4a22b3ae7d041b582b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76df23454a3c4a9bb4f61b044ed5a426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:05:23.570761 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-ebbccdf9-a704-47db-94ab-faaa8971135f tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] 10.222.0.20 "GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f" status: 200 len: 1379 microversion: 2.1 time: 0.151938 Jul 30 05:05:23.583252 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 502/1050] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:05:23 2022] GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f => generated 1379 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:05:23.653163 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-f2fd2e91-ff01-4305-8975-eb5db241301c req-050d9a4a-182e-4928-af6e-56322b3b4b6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99b497c8-e641-428a-94b6-86c21af5844f", "name": "network-vif-deleted", "tag": "1a76ab0f-eada-4891-8b4c-b2af44036eb1"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:05:23.670995 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-f2fd2e91-ff01-4305-8975-eb5db241301c req-050d9a4a-182e-4928-af6e-56322b3b4b6b service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:23.671669 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-f2fd2e91-ff01-4305-8975-eb5db241301c req-050d9a4a-182e-4928-af6e-56322b3b4b6b service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:23.676700 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:05:23.691673 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-f2fd2e91-ff01-4305-8975-eb5db241301c req-050d9a4a-182e-4928-af6e-56322b3b4b6b service nova] Creating event network-vif-deleted:1a76ab0f-eada-4891-8b4c-b2af44036eb1 for instance 99b497c8-e641-428a-94b6-86c21af5844f on hv-cinder-85127 Jul 30 05:05:23.698739 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-f2fd2e91-ff01-4305-8975-eb5db241301c req-050d9a4a-182e-4928-af6e-56322b3b4b6b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051954 Jul 30 05:05:23.699985 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 549/1051] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Jul 30 05:05:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 05:05:24.593102 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-697b2858-710c-4e68-a11a-3227068d2872 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:05:24.593755 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-697b2858-710c-4e68-a11a-3227068d2872 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] [instance: 99b497c8-e641-428a-94b6-86c21af5844f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:05:24.601318 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-697b2858-710c-4e68-a11a-3227068d2872 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:24.601773 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-697b2858-710c-4e68-a11a-3227068d2872 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:24.602579 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-697b2858-710c-4e68-a11a-3227068d2872 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:24.603024 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-697b2858-710c-4e68-a11a-3227068d2872 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:24.634096 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-697b2858-710c-4e68-a11a-3227068d2872 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:24.634637 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-697b2858-710c-4e68-a11a-3227068d2872 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:24.635107 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.objects.instance [None req-697b2858-710c-4e68-a11a-3227068d2872 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lazy-loading 'fault' on Instance uuid 99b497c8-e641-428a-94b6-86c21af5844f {{(pid=117885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 05:05:24.678831 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-697b2858-710c-4e68-a11a-3227068d2872 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a98edf8e5a4a22b3ae7d041b582b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76df23454a3c4a9bb4f61b044ed5a426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:05:24.687067 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-697b2858-710c-4e68-a11a-3227068d2872 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] 10.222.0.20 "GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f" status: 200 len: 1222 microversion: 2.1 time: 0.097806 Jul 30 05:05:24.687814 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 503/1052] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:05:24 2022] GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f => generated 1222 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:05:25.710796 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-44d788ae-9e5d-4460-83e7-0d6e99a39169 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:05:25.711577 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-44d788ae-9e5d-4460-83e7-0d6e99a39169 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] [instance: 99b497c8-e641-428a-94b6-86c21af5844f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:05:25.719187 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-44d788ae-9e5d-4460-83e7-0d6e99a39169 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:25.719640 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-44d788ae-9e5d-4460-83e7-0d6e99a39169 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:25.720916 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-44d788ae-9e5d-4460-83e7-0d6e99a39169 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:25.721885 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-44d788ae-9e5d-4460-83e7-0d6e99a39169 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:25.735022 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.wsgi [None req-44d788ae-9e5d-4460-83e7-0d6e99a39169 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] HTTP exception thrown: Instance 99b497c8-e641-428a-94b6-86c21af5844f could not be found. Jul 30 05:05:25.737862 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-44d788ae-9e5d-4460-83e7-0d6e99a39169 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Request method failure captured: Jul 30 05:05:25.737862 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: request: GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f HTTP/1.1 Jul 30 05:05:25.737862 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Accept: application/json Jul 30 05:05:25.737862 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Accept-Encoding: identity Jul 30 05:05:25.737862 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Connection: close Jul 30 05:05:25.737862 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Content-Length: 0 Jul 30 05:05:25.737862 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Content-Type: application/json Jul 30 05:05:25.737862 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Host: 10.222.0.20 Jul 30 05:05:25.737862 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Openstack-System-Scope: None Jul 30 05:05:25.737862 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: User-Agent: python-urllib3/1.26.10 Jul 30 05:05:25.737862 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Auth-Token: gAAAAABi5Lq6sZv8RX38Yk95olrULs-1fxAn_Hx7Af2qYGkvTqRW58YQ_hd_xGg2rzRQT8geesMIQtRT1rF7nY3DkMS_yKdh0q15OS-zwMSNorjig_0hpdFuRYJ_-As-lunwTYY6siL3nIMLUIK31x7eiBEq8hZ6mmQ8ebwVy1jXDRitJ6oS0RA Jul 30 05:05:25.737862 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Domain-Id: None Jul 30 05:05:25.737862 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Domain-Name: None Jul 30 05:05:25.737862 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Identity-Status: Confirmed Jul 30 05:05:25.737862 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Is-Admin-Project: True Jul 30 05:05:25.737862 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Project-Domain-Id: default Jul 30 05:05:25.737862 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Project-Domain-Name: Default Jul 30 05:05:25.737862 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Project-Id: 76df23454a3c4a9bb4f61b044ed5a426 Jul 30 05:05:25.737862 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Project-Name: tempest-TestShelveInstance-926399645 Jul 30 05:05:25.737862 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Role: member,reader Jul 30 05:05:25.737862 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Roles: member,reader Jul 30 05:05:25.739596 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/76df23454a3c4a9bb4f61b044ed5a426"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/76df23454a3c4a9bb4f61b044ed5a426"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_76df23454a3c4a9bb4f61b044ed5a426"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/76df23454a3c4a9bb4f61b044ed5a426"}]}] Jul 30 05:05:25.739596 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Tenant: tempest-TestShelveInstance-926399645 Jul 30 05:05:25.739596 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Tenant-Id: 76df23454a3c4a9bb4f61b044ed5a426 Jul 30 05:05:25.739596 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Tenant-Name: tempest-TestShelveInstance-926399645 Jul 30 05:05:25.739596 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User: tempest-TestShelveInstance-926399645-project Jul 30 05:05:25.739596 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User-Domain-Id: default Jul 30 05:05:25.739596 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User-Domain-Name: Default Jul 30 05:05:25.739596 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User-Id: b1a98edf8e5a4a22b3ae7d041b582b2d Jul 30 05:05:25.739596 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User-Name: tempest-TestShelveInstance-926399645-project Jul 30 05:05:25.739596 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: method: > Jul 30 05:05:25.739596 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: exception: Instance 99b497c8-e641-428a-94b6-86c21af5844f could not be found. Jul 30 05:05:25.739596 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: action_args: {'id': '99b497c8-e641-428a-94b6-86c21af5844f'} Jul 30 05:05:25.740586 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 05:05:25.740586 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:05:25.740586 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 05:05:25.740586 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 05:05:25.740586 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 05:05:25.740586 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 05:05:25.740586 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 05:05:25.740586 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 05:05:25.740586 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 05:05:25.740586 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 05:05:25.740586 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99b497c8-e641-428a-94b6-86c21af5844f could not be found. Jul 30 05:05:25.740586 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 05:05:25.740586 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 05:05:25.740586 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 05:05:25.740586 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:05:25.740586 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 05:05:25.740586 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 05:05:25.740586 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 05:05:25.740586 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 05:05:25.740586 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 05:05:25.742242 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 05:05:25.742242 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 05:05:25.742242 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 05:05:25.742242 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 05:05:25.742242 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 05:05:25.742242 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 05:05:25.742242 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 05:05:25.742242 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99b497c8-e641-428a-94b6-86c21af5844f could not be found. Jul 30 05:05:25.742242 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 05:05:25.742242 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 05:05:25.742242 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 05:05:25.742242 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:05:25.742242 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 05:05:25.742242 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 05:05:25.742242 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 05:05:25.742242 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 05:05:25.742242 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99b497c8-e641-428a-94b6-86c21af5844f could not be found. Jul 30 05:05:25.742242 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 05:05:25.743797 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-44d788ae-9e5d-4460-83e7-0d6e99a39169 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Returning 404 to user: Instance 99b497c8-e641-428a-94b6-86c21af5844f could not be found. {{(pid=117886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 05:05:25.743797 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-44d788ae-9e5d-4460-83e7-0d6e99a39169 tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] 10.222.0.20 "GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f" status: 404 len: 111 microversion: 2.1 time: 0.033302 Jul 30 05:05:25.743797 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 550/1053] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:05:25 2022] GET /compute/v2.1/servers/99b497c8-e641-428a-94b6-86c21af5844f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 05:05:25.903365 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-7d8540f2-7566-4332-b49d-56668eb1c1eb tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] Calling method '.version_select at 0x7f2daf77dc10>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:05:25.929375 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-7d8540f2-7566-4332-b49d-56668eb1c1eb tempest-TestShelveInstance-926399645 tempest-TestShelveInstance-926399645-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-157398780" status: 202 len: 0 microversion: 2.1 time: 0.029804 Jul 30 05:05:25.930264 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 504/1054] 10.222.0.20 () {58 vars in 1251 bytes} [Sat Jul 30 05:05:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-157398780 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 05:05:36.330877 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-634572a7-31d9-49ba-83c0-eb722c24d3be tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:05:36.333315 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-634572a7-31d9-49ba-83c0-eb722c24d3be tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:05:36.335657 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_api:SELECT=12,nova_api:UPDATE=1 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:05:36.336395 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=3 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:05:36.342248 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-634572a7-31d9-49ba-83c0-eb722c24d3be tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:36.342841 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-634572a7-31d9-49ba-83c0-eb722c24d3be tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:36.343619 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-634572a7-31d9-49ba-83c0-eb722c24d3be tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:36.344061 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-634572a7-31d9-49ba-83c0-eb722c24d3be tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:36.374640 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-634572a7-31d9-49ba-83c0-eb722c24d3be tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.050653 Jul 30 05:05:36.375187 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 551/1055] 10.222.0.20 () {60 vars in 1343 bytes} [Sat Jul 30 05:05:36 2022] GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:05:36.440034 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell1:SELECT=22 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:05:36.440750 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:05:36.444873 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-3413f8de-dc4e-45f5-8712-9a3594743cc1 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:05:36.445642 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-3413f8de-dc4e-45f5-8712-9a3594743cc1 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:05:36.453889 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3413f8de-dc4e-45f5-8712-9a3594743cc1 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:36.454974 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3413f8de-dc4e-45f5-8712-9a3594743cc1 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:36.455755 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3413f8de-dc4e-45f5-8712-9a3594743cc1 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:36.456202 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3413f8de-dc4e-45f5-8712-9a3594743cc1 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:36.482505 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-3413f8de-dc4e-45f5-8712-9a3594743cc1 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b] Going to try to terminate instance {{(pid=117885) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 05:05:36.562853 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-3413f8de-dc4e-45f5-8712-9a3594743cc1 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b" status: 204 len: 0 microversion: 2.20 time: 0.124176 Jul 30 05:05:36.563867 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 505/1056] 10.222.0.20 () {60 vars in 1280 bytes} [Sat Jul 30 05:05:36 2022] DELETE /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 30 05:05:36.572178 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-74338947-5546-4fe0-8103-01055a954337 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:05:36.573547 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-74338947-5546-4fe0-8103-01055a954337 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:05:36.580094 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-74338947-5546-4fe0-8103-01055a954337 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:36.580723 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-74338947-5546-4fe0-8103-01055a954337 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:36.581664 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-74338947-5546-4fe0-8103-01055a954337 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:36.582100 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-74338947-5546-4fe0-8103-01055a954337 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:36.716295 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-74338947-5546-4fe0-8103-01055a954337 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:05:36.725667 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-74338947-5546-4fe0-8103-01055a954337 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:05:36.727260 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-74338947-5546-4fe0-8103-01055a954337 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:05:36.728548 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-74338947-5546-4fe0-8103-01055a954337 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b" status: 200 len: 1724 microversion: 2.20 time: 0.160399 Jul 30 05:05:36.729281 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 552/1057] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:05:36 2022] GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 30 05:05:37.755322 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-b73f1126-7257-44ed-9bcf-366527f96ccb tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:05:37.756129 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-b73f1126-7257-44ed-9bcf-366527f96ccb tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:05:37.762603 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b73f1126-7257-44ed-9bcf-366527f96ccb tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:37.763056 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b73f1126-7257-44ed-9bcf-366527f96ccb tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:37.763828 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b73f1126-7257-44ed-9bcf-366527f96ccb tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:37.764273 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b73f1126-7257-44ed-9bcf-366527f96ccb tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:37.895777 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-b73f1126-7257-44ed-9bcf-366527f96ccb tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:05:37.903913 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-b73f1126-7257-44ed-9bcf-366527f96ccb tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:05:37.905416 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-b73f1126-7257-44ed-9bcf-366527f96ccb tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:05:37.906644 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-b73f1126-7257-44ed-9bcf-366527f96ccb tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b" status: 200 len: 1724 microversion: 2.20 time: 0.157223 Jul 30 05:05:37.907202 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 506/1058] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:05:37 2022] GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 05:05:38.771609 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-f73b30c3-efd3-43e6-af76-d8b9a08d4311 req-ce84cccf-c1e7-43ae-a972-be227abed8c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b", "name": "network-vif-deleted", "tag": "6ca5af71-3aff-4af4-9271-ac47c637cc34"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:05:38.782128 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-f73b30c3-efd3-43e6-af76-d8b9a08d4311 req-ce84cccf-c1e7-43ae-a972-be227abed8c0 service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:38.782630 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-f73b30c3-efd3-43e6-af76-d8b9a08d4311 req-ce84cccf-c1e7-43ae-a972-be227abed8c0 service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:38.797123 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-f73b30c3-efd3-43e6-af76-d8b9a08d4311 req-ce84cccf-c1e7-43ae-a972-be227abed8c0 service nova] Creating event network-vif-deleted:6ca5af71-3aff-4af4-9271-ac47c637cc34 for instance b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b on hv-cinder-85127 Jul 30 05:05:38.802724 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-f73b30c3-efd3-43e6-af76-d8b9a08d4311 req-ce84cccf-c1e7-43ae-a972-be227abed8c0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035399 Jul 30 05:05:38.803335 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 553/1059] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Jul 30 05:05:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 05:05:38.940391 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-c6b7d5ae-601b-4503-ba9b-7a4a1facb632 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:05:38.956068 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-c6b7d5ae-601b-4503-ba9b-7a4a1facb632 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:05:38.973457 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c6b7d5ae-601b-4503-ba9b-7a4a1facb632 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:38.978387 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c6b7d5ae-601b-4503-ba9b-7a4a1facb632 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:38.979278 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c6b7d5ae-601b-4503-ba9b-7a4a1facb632 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:38.979727 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c6b7d5ae-601b-4503-ba9b-7a4a1facb632 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:39.036012 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c6b7d5ae-601b-4503-ba9b-7a4a1facb632 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:39.036719 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c6b7d5ae-601b-4503-ba9b-7a4a1facb632 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:39.037358 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.objects.instance [None req-c6b7d5ae-601b-4503-ba9b-7a4a1facb632 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lazy-loading 'fault' on Instance uuid b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b {{(pid=117885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 05:05:39.083601 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-c6b7d5ae-601b-4503-ba9b-7a4a1facb632 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:05:39.091433 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-c6b7d5ae-601b-4503-ba9b-7a4a1facb632 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:05:39.092880 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-c6b7d5ae-601b-4503-ba9b-7a4a1facb632 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3a56c6d44b74429a6616cdfc2869b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6f8afc1abf427f92c44fdc55994b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:05:39.094241 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-c6b7d5ae-601b-4503-ba9b-7a4a1facb632 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b" status: 200 len: 1372 microversion: 2.20 time: 0.167821 Jul 30 05:05:39.094984 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 507/1060] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:05:38 2022] GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b => generated 1372 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 30 05:05:40.118972 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-1a18577d-cd13-4af4-889c-6bae2919c357 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:05:40.119747 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-1a18577d-cd13-4af4-889c-6bae2919c357 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:05:40.126099 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1a18577d-cd13-4af4-889c-6bae2919c357 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:40.126825 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1a18577d-cd13-4af4-889c-6bae2919c357 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:40.128257 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1a18577d-cd13-4af4-889c-6bae2919c357 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:40.128692 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1a18577d-cd13-4af4-889c-6bae2919c357 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:40.142164 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.wsgi [None req-1a18577d-cd13-4af4-889c-6bae2919c357 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] HTTP exception thrown: Instance b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b could not be found. Jul 30 05:05:40.144605 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-1a18577d-cd13-4af4-889c-6bae2919c357 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Request method failure captured: Jul 30 05:05:40.144605 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: request: GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b HTTP/1.1 Jul 30 05:05:40.144605 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Accept: application/json Jul 30 05:05:40.144605 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Accept-Encoding: identity Jul 30 05:05:40.144605 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Connection: close Jul 30 05:05:40.144605 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Content-Length: 0 Jul 30 05:05:40.144605 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Content-Type: application/json Jul 30 05:05:40.144605 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Host: 10.222.0.20 Jul 30 05:05:40.144605 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Openstack-System-Scope: None Jul 30 05:05:40.144605 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: User-Agent: python-urllib3/1.26.10 Jul 30 05:05:40.144605 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Auth-Token: gAAAAABi5Lps1aYmuC12Yad7gE7AWSoKC92IYRluU7k6ePMSJV_5YZ_RF6tmLr7JLHaidp3snp7fO3IOYPrhHS4jpmzbSFUtIDlhdmzFr6Y0Y4ChpwG1lnSwznqLkHPDg6LX4U9ITCr11oprAilfxNOB1R_3WeHA0Os43SN5pjNxUgT8BOG34vY Jul 30 05:05:40.144605 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Domain-Id: None Jul 30 05:05:40.144605 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Domain-Name: None Jul 30 05:05:40.144605 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Identity-Status: Confirmed Jul 30 05:05:40.144605 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Is-Admin-Project: True Jul 30 05:05:40.144605 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Openstack-Nova-Api-Version: 2.20 Jul 30 05:05:40.144605 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Project-Domain-Id: default Jul 30 05:05:40.144605 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Project-Domain-Name: Default Jul 30 05:05:40.144605 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Project-Id: bc6f8afc1abf427f92c44fdc55994b18 Jul 30 05:05:40.144605 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1684292964 Jul 30 05:05:40.144605 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Role: member,reader Jul 30 05:05:40.144605 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Roles: member,reader Jul 30 05:05:40.146290 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bc6f8afc1abf427f92c44fdc55994b18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bc6f8afc1abf427f92c44fdc55994b18"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_bc6f8afc1abf427f92c44fdc55994b18"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/bc6f8afc1abf427f92c44fdc55994b18"}]}] Jul 30 05:05:40.146290 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1684292964 Jul 30 05:05:40.146290 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Tenant-Id: bc6f8afc1abf427f92c44fdc55994b18 Jul 30 05:05:40.146290 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1684292964 Jul 30 05:05:40.146290 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User: tempest-AttachVolumeShelveTestJSON-1684292964-project Jul 30 05:05:40.146290 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User-Domain-Id: default Jul 30 05:05:40.146290 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User-Domain-Name: Default Jul 30 05:05:40.146290 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User-Id: d3a56c6d44b74429a6616cdfc2869b71 Jul 30 05:05:40.146290 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1684292964-project Jul 30 05:05:40.146290 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: method: > Jul 30 05:05:40.146290 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: exception: Instance b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b could not be found. Jul 30 05:05:40.146290 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: action_args: {'id': 'b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b'} Jul 30 05:05:40.147275 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 05:05:40.147275 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:05:40.147275 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 05:05:40.147275 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 05:05:40.147275 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 05:05:40.147275 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 05:05:40.147275 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 05:05:40.147275 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 05:05:40.147275 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 05:05:40.147275 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 05:05:40.147275 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b could not be found. Jul 30 05:05:40.147275 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 05:05:40.147275 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 05:05:40.147275 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 05:05:40.147275 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:05:40.147275 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 05:05:40.147275 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 05:05:40.147275 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 05:05:40.147275 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 05:05:40.147275 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 05:05:40.148774 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 05:05:40.148774 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 05:05:40.148774 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 05:05:40.148774 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 05:05:40.148774 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 05:05:40.148774 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 05:05:40.148774 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 05:05:40.148774 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b could not be found. Jul 30 05:05:40.148774 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 05:05:40.148774 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 05:05:40.148774 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 05:05:40.148774 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:05:40.148774 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 05:05:40.148774 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 05:05:40.148774 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 05:05:40.148774 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 05:05:40.148774 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b could not be found. Jul 30 05:05:40.148774 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 05:05:40.150140 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-1a18577d-cd13-4af4-889c-6bae2919c357 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Returning 404 to user: Instance b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b could not be found. {{(pid=117886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 05:05:40.150140 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-1a18577d-cd13-4af4-889c-6bae2919c357 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b" status: 404 len: 111 microversion: 2.20 time: 0.032103 Jul 30 05:05:40.150140 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 554/1061] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:05:40 2022] GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 30 05:05:40.156194 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-2f1f9815-5653-4618-8e1d-93dcaacff960 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '.version_select at 0x7f2db40384c0>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:05:40.175209 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-2f1f9815-5653-4618-8e1d-93dcaacff960 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1851664937" status: 204 len: 0 microversion: 2.20 time: 0.023262 Jul 30 05:05:40.175749 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 508/1062] 10.222.0.20 () {60 vars in 1262 bytes} [Sat Jul 30 05:05:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1851664937 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 30 05:05:42.183470 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-76cb5cf9-c755-416f-bcaa-5da501c88c47 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:05:42.183966 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-76cb5cf9-c755-416f-bcaa-5da501c88c47 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:05:42.190428 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-76cb5cf9-c755-416f-bcaa-5da501c88c47 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:42.190892 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-76cb5cf9-c755-416f-bcaa-5da501c88c47 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:42.191659 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-76cb5cf9-c755-416f-bcaa-5da501c88c47 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:42.192092 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-76cb5cf9-c755-416f-bcaa-5da501c88c47 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:42.205236 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.wsgi [None req-76cb5cf9-c755-416f-bcaa-5da501c88c47 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] HTTP exception thrown: Instance b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b could not be found. Jul 30 05:05:42.207074 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-76cb5cf9-c755-416f-bcaa-5da501c88c47 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Request method failure captured: Jul 30 05:05:42.207074 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: request: DELETE /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b HTTP/1.1 Jul 30 05:05:42.207074 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Accept: application/json Jul 30 05:05:42.207074 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Accept-Encoding: identity Jul 30 05:05:42.207074 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Connection: close Jul 30 05:05:42.207074 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Content-Length: 0 Jul 30 05:05:42.207074 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Content-Type: application/json Jul 30 05:05:42.207074 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Host: 10.222.0.20 Jul 30 05:05:42.207074 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Openstack-System-Scope: None Jul 30 05:05:42.207074 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: User-Agent: python-urllib3/1.26.10 Jul 30 05:05:42.207074 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Auth-Token: gAAAAABi5Lps1aYmuC12Yad7gE7AWSoKC92IYRluU7k6ePMSJV_5YZ_RF6tmLr7JLHaidp3snp7fO3IOYPrhHS4jpmzbSFUtIDlhdmzFr6Y0Y4ChpwG1lnSwznqLkHPDg6LX4U9ITCr11oprAilfxNOB1R_3WeHA0Os43SN5pjNxUgT8BOG34vY Jul 30 05:05:42.207074 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Domain-Id: None Jul 30 05:05:42.207074 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Domain-Name: None Jul 30 05:05:42.207074 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Identity-Status: Confirmed Jul 30 05:05:42.207074 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Is-Admin-Project: True Jul 30 05:05:42.207074 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Openstack-Nova-Api-Version: 2.20 Jul 30 05:05:42.207074 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Project-Domain-Id: default Jul 30 05:05:42.207074 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Project-Domain-Name: Default Jul 30 05:05:42.207074 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Project-Id: bc6f8afc1abf427f92c44fdc55994b18 Jul 30 05:05:42.207074 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1684292964 Jul 30 05:05:42.207074 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Role: member,reader Jul 30 05:05:42.207074 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Roles: member,reader Jul 30 05:05:42.208802 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bc6f8afc1abf427f92c44fdc55994b18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bc6f8afc1abf427f92c44fdc55994b18"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_bc6f8afc1abf427f92c44fdc55994b18"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/bc6f8afc1abf427f92c44fdc55994b18"}]}] Jul 30 05:05:42.208802 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1684292964 Jul 30 05:05:42.208802 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Tenant-Id: bc6f8afc1abf427f92c44fdc55994b18 Jul 30 05:05:42.208802 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1684292964 Jul 30 05:05:42.208802 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User: tempest-AttachVolumeShelveTestJSON-1684292964-project Jul 30 05:05:42.208802 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User-Domain-Id: default Jul 30 05:05:42.208802 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User-Domain-Name: Default Jul 30 05:05:42.208802 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User-Id: d3a56c6d44b74429a6616cdfc2869b71 Jul 30 05:05:42.208802 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1684292964-project Jul 30 05:05:42.208802 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: method: > Jul 30 05:05:42.208802 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: exception: Instance b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b could not be found. Jul 30 05:05:42.208802 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: action_args: {'id': 'b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b'} Jul 30 05:05:42.209719 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 05:05:42.209719 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:05:42.209719 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 05:05:42.209719 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 05:05:42.209719 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 05:05:42.209719 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 05:05:42.209719 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 05:05:42.209719 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 05:05:42.209719 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 05:05:42.209719 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 05:05:42.209719 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b could not be found. Jul 30 05:05:42.209719 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 05:05:42.209719 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 05:05:42.209719 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 05:05:42.209719 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:05:42.209719 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 05:05:42.209719 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 05:05:42.209719 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 05:05:42.209719 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 05:05:42.209719 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 05:05:42.211271 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 05:05:42.211271 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 30 05:05:42.211271 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 30 05:05:42.211271 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 30 05:05:42.211271 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 30 05:05:42.211271 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 05:05:42.211271 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 05:05:42.211271 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 05:05:42.211271 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 05:05:42.211271 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b could not be found. Jul 30 05:05:42.211271 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 05:05:42.211271 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 05:05:42.211271 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 05:05:42.211271 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:05:42.211271 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 05:05:42.211271 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 05:05:42.211271 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 05:05:42.211271 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 05:05:42.211271 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b could not be found. Jul 30 05:05:42.211271 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 05:05:42.212780 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-76cb5cf9-c755-416f-bcaa-5da501c88c47 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Returning 404 to user: Instance b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b could not be found. {{(pid=117886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 05:05:42.212780 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-76cb5cf9-c755-416f-bcaa-5da501c88c47 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b" status: 404 len: 111 microversion: 2.20 time: 0.028900 Jul 30 05:05:42.212780 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 555/1063] 10.222.0.20 () {60 vars in 1280 bytes} [Sat Jul 30 05:05:42 2022] DELETE /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 30 05:05:42.218902 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-eca22013-f15a-45bc-902e-66a2e6a0f939 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:05:42.219647 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-eca22013-f15a-45bc-902e-66a2e6a0f939 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:05:42.228033 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-eca22013-f15a-45bc-902e-66a2e6a0f939 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:42.228490 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-eca22013-f15a-45bc-902e-66a2e6a0f939 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:42.229297 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-eca22013-f15a-45bc-902e-66a2e6a0f939 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:42.230195 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-eca22013-f15a-45bc-902e-66a2e6a0f939 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:42.244877 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.wsgi [None req-eca22013-f15a-45bc-902e-66a2e6a0f939 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] HTTP exception thrown: Instance b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b could not be found. Jul 30 05:05:42.246583 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-eca22013-f15a-45bc-902e-66a2e6a0f939 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Request method failure captured: Jul 30 05:05:42.246583 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: request: GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b HTTP/1.1 Jul 30 05:05:42.246583 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Accept: application/json Jul 30 05:05:42.246583 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Accept-Encoding: identity Jul 30 05:05:42.246583 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Connection: close Jul 30 05:05:42.246583 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Content-Length: 0 Jul 30 05:05:42.246583 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Content-Type: application/json Jul 30 05:05:42.246583 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Host: 10.222.0.20 Jul 30 05:05:42.246583 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Openstack-System-Scope: None Jul 30 05:05:42.246583 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: User-Agent: python-urllib3/1.26.10 Jul 30 05:05:42.246583 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Auth-Token: gAAAAABi5Lps1aYmuC12Yad7gE7AWSoKC92IYRluU7k6ePMSJV_5YZ_RF6tmLr7JLHaidp3snp7fO3IOYPrhHS4jpmzbSFUtIDlhdmzFr6Y0Y4ChpwG1lnSwznqLkHPDg6LX4U9ITCr11oprAilfxNOB1R_3WeHA0Os43SN5pjNxUgT8BOG34vY Jul 30 05:05:42.246583 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Domain-Id: None Jul 30 05:05:42.246583 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Domain-Name: None Jul 30 05:05:42.246583 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Identity-Status: Confirmed Jul 30 05:05:42.246583 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Is-Admin-Project: True Jul 30 05:05:42.246583 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Openstack-Nova-Api-Version: 2.20 Jul 30 05:05:42.246583 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Domain-Id: default Jul 30 05:05:42.246583 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Domain-Name: Default Jul 30 05:05:42.246583 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Id: bc6f8afc1abf427f92c44fdc55994b18 Jul 30 05:05:42.246583 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1684292964 Jul 30 05:05:42.246583 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Role: member,reader Jul 30 05:05:42.246583 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Roles: member,reader Jul 30 05:05:42.248196 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bc6f8afc1abf427f92c44fdc55994b18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bc6f8afc1abf427f92c44fdc55994b18"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_bc6f8afc1abf427f92c44fdc55994b18"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/bc6f8afc1abf427f92c44fdc55994b18"}]}] Jul 30 05:05:42.248196 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1684292964 Jul 30 05:05:42.248196 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Tenant-Id: bc6f8afc1abf427f92c44fdc55994b18 Jul 30 05:05:42.248196 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1684292964 Jul 30 05:05:42.248196 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User: tempest-AttachVolumeShelveTestJSON-1684292964-project Jul 30 05:05:42.248196 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Domain-Id: default Jul 30 05:05:42.248196 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Domain-Name: Default Jul 30 05:05:42.248196 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Id: d3a56c6d44b74429a6616cdfc2869b71 Jul 30 05:05:42.248196 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1684292964-project Jul 30 05:05:42.248196 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: method: > Jul 30 05:05:42.248196 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: exception: Instance b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b could not be found. Jul 30 05:05:42.248196 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: action_args: {'id': 'b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b'} Jul 30 05:05:42.249034 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 05:05:42.249034 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:05:42.249034 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 05:05:42.249034 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 05:05:42.249034 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 05:05:42.249034 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 05:05:42.249034 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 05:05:42.249034 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 05:05:42.249034 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 05:05:42.249034 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 05:05:42.249034 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b could not be found. Jul 30 05:05:42.249034 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:05:42.249034 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 05:05:42.249034 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:05:42.249034 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:05:42.249034 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 05:05:42.249034 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 05:05:42.249034 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 05:05:42.249034 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 05:05:42.249034 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 05:05:42.250747 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 05:05:42.250747 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 05:05:42.250747 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 05:05:42.250747 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 05:05:42.250747 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 05:05:42.250747 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 05:05:42.250747 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 05:05:42.250747 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b could not be found. Jul 30 05:05:42.250747 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:05:42.250747 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 05:05:42.250747 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:05:42.250747 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:05:42.250747 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 05:05:42.250747 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 05:05:42.250747 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 05:05:42.250747 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 05:05:42.250747 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b could not be found. Jul 30 05:05:42.250747 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:05:42.251962 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-eca22013-f15a-45bc-902e-66a2e6a0f939 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Returning 404 to user: Instance b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b could not be found. {{(pid=117885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 05:05:42.251962 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-eca22013-f15a-45bc-902e-66a2e6a0f939 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b" status: 404 len: 111 microversion: 2.20 time: 0.034709 Jul 30 05:05:42.251962 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 509/1064] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:05:42 2022] GET /compute/v2.1/servers/b19dff6e-8805-4d1b-a9fa-2cc8cdb7880b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 30 05:05:43.401245 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-7a89313f-3dd9-4dc7-9a84-0d440a67ae66 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:05:43.401777 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-7a89313f-3dd9-4dc7-9a84-0d440a67ae66 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:05:43.411409 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7a89313f-3dd9-4dc7-9a84-0d440a67ae66 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:43.411857 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7a89313f-3dd9-4dc7-9a84-0d440a67ae66 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:43.412633 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7a89313f-3dd9-4dc7-9a84-0d440a67ae66 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:43.413191 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7a89313f-3dd9-4dc7-9a84-0d440a67ae66 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:43.428746 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.wsgi [None req-7a89313f-3dd9-4dc7-9a84-0d440a67ae66 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] HTTP exception thrown: Instance e4370e65-bec4-454f-9566-33ff60441229 could not be found. Jul 30 05:05:43.430300 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-7a89313f-3dd9-4dc7-9a84-0d440a67ae66 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Request method failure captured: Jul 30 05:05:43.430300 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: request: DELETE /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 HTTP/1.1 Jul 30 05:05:43.430300 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Accept: application/json Jul 30 05:05:43.430300 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Accept-Encoding: identity Jul 30 05:05:43.430300 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Connection: close Jul 30 05:05:43.430300 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Content-Length: 0 Jul 30 05:05:43.430300 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Content-Type: application/json Jul 30 05:05:43.430300 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Host: 10.222.0.20 Jul 30 05:05:43.430300 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Openstack-System-Scope: None Jul 30 05:05:43.430300 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: User-Agent: python-urllib3/1.26.10 Jul 30 05:05:43.430300 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Auth-Token: gAAAAABi5Lps1aYmuC12Yad7gE7AWSoKC92IYRluU7k6ePMSJV_5YZ_RF6tmLr7JLHaidp3snp7fO3IOYPrhHS4jpmzbSFUtIDlhdmzFr6Y0Y4ChpwG1lnSwznqLkHPDg6LX4U9ITCr11oprAilfxNOB1R_3WeHA0Os43SN5pjNxUgT8BOG34vY Jul 30 05:05:43.430300 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Domain-Id: None Jul 30 05:05:43.430300 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Domain-Name: None Jul 30 05:05:43.430300 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Identity-Status: Confirmed Jul 30 05:05:43.430300 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Is-Admin-Project: True Jul 30 05:05:43.430300 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Openstack-Nova-Api-Version: 2.20 Jul 30 05:05:43.430300 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Project-Domain-Id: default Jul 30 05:05:43.430300 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Project-Domain-Name: Default Jul 30 05:05:43.430300 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Project-Id: bc6f8afc1abf427f92c44fdc55994b18 Jul 30 05:05:43.430300 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1684292964 Jul 30 05:05:43.430300 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Role: member,reader Jul 30 05:05:43.430300 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Roles: member,reader Jul 30 05:05:43.431991 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bc6f8afc1abf427f92c44fdc55994b18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bc6f8afc1abf427f92c44fdc55994b18"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_bc6f8afc1abf427f92c44fdc55994b18"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/bc6f8afc1abf427f92c44fdc55994b18"}]}] Jul 30 05:05:43.431991 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1684292964 Jul 30 05:05:43.431991 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Tenant-Id: bc6f8afc1abf427f92c44fdc55994b18 Jul 30 05:05:43.431991 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1684292964 Jul 30 05:05:43.431991 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User: tempest-AttachVolumeShelveTestJSON-1684292964-project Jul 30 05:05:43.431991 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User-Domain-Id: default Jul 30 05:05:43.431991 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User-Domain-Name: Default Jul 30 05:05:43.431991 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User-Id: d3a56c6d44b74429a6616cdfc2869b71 Jul 30 05:05:43.431991 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1684292964-project Jul 30 05:05:43.431991 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: method: > Jul 30 05:05:43.431991 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: exception: Instance e4370e65-bec4-454f-9566-33ff60441229 could not be found. Jul 30 05:05:43.431991 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: action_args: {'id': 'e4370e65-bec4-454f-9566-33ff60441229'} Jul 30 05:05:43.432873 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 05:05:43.432873 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:05:43.432873 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 05:05:43.432873 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 05:05:43.432873 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 05:05:43.432873 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 05:05:43.432873 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 05:05:43.432873 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 05:05:43.432873 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 05:05:43.432873 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 05:05:43.432873 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4370e65-bec4-454f-9566-33ff60441229 could not be found. Jul 30 05:05:43.432873 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 05:05:43.432873 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 05:05:43.432873 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 05:05:43.432873 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:05:43.432873 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 05:05:43.432873 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 05:05:43.432873 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 05:05:43.432873 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 05:05:43.432873 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 05:05:43.434358 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 05:05:43.434358 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 30 05:05:43.434358 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 30 05:05:43.434358 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 30 05:05:43.434358 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 30 05:05:43.434358 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 05:05:43.434358 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 05:05:43.434358 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 05:05:43.434358 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 05:05:43.434358 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4370e65-bec4-454f-9566-33ff60441229 could not be found. Jul 30 05:05:43.434358 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 05:05:43.434358 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 05:05:43.434358 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 05:05:43.434358 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:05:43.434358 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 05:05:43.434358 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 05:05:43.434358 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 05:05:43.434358 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 05:05:43.434358 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4370e65-bec4-454f-9566-33ff60441229 could not be found. Jul 30 05:05:43.434358 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 05:05:43.435930 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-7a89313f-3dd9-4dc7-9a84-0d440a67ae66 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Returning 404 to user: Instance e4370e65-bec4-454f-9566-33ff60441229 could not be found. {{(pid=117886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 05:05:43.435930 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-7a89313f-3dd9-4dc7-9a84-0d440a67ae66 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 404 len: 111 microversion: 2.20 time: 0.034476 Jul 30 05:05:43.435930 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 556/1065] 10.222.0.20 () {60 vars in 1280 bytes} [Sat Jul 30 05:05:43 2022] DELETE /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 30 05:05:43.440903 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-1ac9eba9-a081-4549-89ee-19e8d0fafba7 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:05:43.441527 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-1ac9eba9-a081-4549-89ee-19e8d0fafba7 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] [instance: e4370e65-bec4-454f-9566-33ff60441229] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:05:43.447979 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1ac9eba9-a081-4549-89ee-19e8d0fafba7 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:43.448433 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1ac9eba9-a081-4549-89ee-19e8d0fafba7 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:43.449208 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1ac9eba9-a081-4549-89ee-19e8d0fafba7 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:43.449647 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1ac9eba9-a081-4549-89ee-19e8d0fafba7 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:43.463315 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.wsgi [None req-1ac9eba9-a081-4549-89ee-19e8d0fafba7 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] HTTP exception thrown: Instance e4370e65-bec4-454f-9566-33ff60441229 could not be found. Jul 30 05:05:43.464983 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-1ac9eba9-a081-4549-89ee-19e8d0fafba7 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Request method failure captured: Jul 30 05:05:43.464983 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: request: GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 HTTP/1.1 Jul 30 05:05:43.464983 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Accept: application/json Jul 30 05:05:43.464983 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Accept-Encoding: identity Jul 30 05:05:43.464983 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Connection: close Jul 30 05:05:43.464983 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Content-Length: 0 Jul 30 05:05:43.464983 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Content-Type: application/json Jul 30 05:05:43.464983 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Host: 10.222.0.20 Jul 30 05:05:43.464983 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Openstack-System-Scope: None Jul 30 05:05:43.464983 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: User-Agent: python-urllib3/1.26.10 Jul 30 05:05:43.464983 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Auth-Token: gAAAAABi5Lps1aYmuC12Yad7gE7AWSoKC92IYRluU7k6ePMSJV_5YZ_RF6tmLr7JLHaidp3snp7fO3IOYPrhHS4jpmzbSFUtIDlhdmzFr6Y0Y4ChpwG1lnSwznqLkHPDg6LX4U9ITCr11oprAilfxNOB1R_3WeHA0Os43SN5pjNxUgT8BOG34vY Jul 30 05:05:43.464983 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Domain-Id: None Jul 30 05:05:43.464983 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Domain-Name: None Jul 30 05:05:43.464983 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Identity-Status: Confirmed Jul 30 05:05:43.464983 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Is-Admin-Project: True Jul 30 05:05:43.464983 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Openstack-Nova-Api-Version: 2.20 Jul 30 05:05:43.464983 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Domain-Id: default Jul 30 05:05:43.464983 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Domain-Name: Default Jul 30 05:05:43.464983 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Id: bc6f8afc1abf427f92c44fdc55994b18 Jul 30 05:05:43.464983 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1684292964 Jul 30 05:05:43.464983 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Role: member,reader Jul 30 05:05:43.464983 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Roles: member,reader Jul 30 05:05:43.466867 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bc6f8afc1abf427f92c44fdc55994b18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bc6f8afc1abf427f92c44fdc55994b18"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_bc6f8afc1abf427f92c44fdc55994b18"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/bc6f8afc1abf427f92c44fdc55994b18"}]}] Jul 30 05:05:43.466867 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1684292964 Jul 30 05:05:43.466867 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Tenant-Id: bc6f8afc1abf427f92c44fdc55994b18 Jul 30 05:05:43.466867 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1684292964 Jul 30 05:05:43.466867 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User: tempest-AttachVolumeShelveTestJSON-1684292964-project Jul 30 05:05:43.466867 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Domain-Id: default Jul 30 05:05:43.466867 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Domain-Name: Default Jul 30 05:05:43.466867 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Id: d3a56c6d44b74429a6616cdfc2869b71 Jul 30 05:05:43.466867 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1684292964-project Jul 30 05:05:43.466867 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: method: > Jul 30 05:05:43.466867 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: exception: Instance e4370e65-bec4-454f-9566-33ff60441229 could not be found. Jul 30 05:05:43.466867 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: action_args: {'id': 'e4370e65-bec4-454f-9566-33ff60441229'} Jul 30 05:05:43.467740 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 05:05:43.467740 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:05:43.467740 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 05:05:43.467740 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 05:05:43.467740 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 05:05:43.467740 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 05:05:43.467740 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 05:05:43.467740 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 05:05:43.467740 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 05:05:43.467740 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 05:05:43.467740 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4370e65-bec4-454f-9566-33ff60441229 could not be found. Jul 30 05:05:43.467740 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:05:43.467740 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 05:05:43.467740 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:05:43.467740 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:05:43.467740 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 05:05:43.467740 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 05:05:43.467740 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 05:05:43.467740 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 05:05:43.467740 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 05:05:43.468964 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 05:05:43.468964 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 05:05:43.468964 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 05:05:43.468964 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 05:05:43.468964 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 05:05:43.468964 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 05:05:43.468964 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 05:05:43.468964 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4370e65-bec4-454f-9566-33ff60441229 could not be found. Jul 30 05:05:43.468964 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:05:43.468964 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 05:05:43.468964 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:05:43.468964 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:05:43.468964 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 05:05:43.468964 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 05:05:43.468964 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 05:05:43.468964 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 05:05:43.468964 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4370e65-bec4-454f-9566-33ff60441229 could not be found. Jul 30 05:05:43.468964 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:05:43.470116 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-1ac9eba9-a081-4549-89ee-19e8d0fafba7 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] Returning 404 to user: Instance e4370e65-bec4-454f-9566-33ff60441229 could not be found. {{(pid=117885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 05:05:43.470116 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-1ac9eba9-a081-4549-89ee-19e8d0fafba7 tempest-AttachVolumeShelveTestJSON-1684292964 tempest-AttachVolumeShelveTestJSON-1684292964-project] 10.222.0.20 "GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229" status: 404 len: 111 microversion: 2.20 time: 0.029511 Jul 30 05:05:43.470116 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 510/1066] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Jul 30 05:05:43 2022] GET /compute/v2.1/servers/e4370e65-bec4-454f-9566-33ff60441229 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 30 05:05:45.334464 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-9ff4da1a-196a-4189-9169-f95eaef85deb tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-326776392"}} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:05:45.335749 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-9ff4da1a-196a-4189-9169-f95eaef85deb tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] [instance: 0faad1c9-0b0d-44af-92cb-dd0acd61c755] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:05:45.343406 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9ff4da1a-196a-4189-9169-f95eaef85deb tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:45.344130 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9ff4da1a-196a-4189-9169-f95eaef85deb tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:45.344902 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9ff4da1a-196a-4189-9169-f95eaef85deb tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:45.345339 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9ff4da1a-196a-4189-9169-f95eaef85deb tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:45.490745 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.network.security_group_api [None req-9ff4da1a-196a-4189-9169-f95eaef85deb tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Removing security group c2e8fdbe-c42e-4a4b-bfe5-089c4b11466f from port abedbf31-d88b-46bc-a1ef-33a68dcc3b21 Jul 30 05:05:45.842204 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-9ff4da1a-196a-4189-9169-f95eaef85deb tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] 10.222.0.20 "POST /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755/action" status: 202 len: 0 microversion: 2.1 time: 0.512515 Jul 30 05:05:45.843939 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 557/1067] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Jul 30 05:05:45 2022] POST /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755/action => generated 0 bytes in 514 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 05:05:45.852131 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-e4d30bd6-d4a9-4c91-8fca-04257daa8596 req-35b82749-61ad-406f-b2d7-56276efcf95f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0faad1c9-0b0d-44af-92cb-dd0acd61c755", "tag": "abedbf31-d88b-46bc-a1ef-33a68dcc3b21"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:05:45.863732 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-e4d30bd6-d4a9-4c91-8fca-04257daa8596 req-35b82749-61ad-406f-b2d7-56276efcf95f service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:45.864454 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-e4d30bd6-d4a9-4c91-8fca-04257daa8596 req-35b82749-61ad-406f-b2d7-56276efcf95f service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:45.880635 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-e4d30bd6-d4a9-4c91-8fca-04257daa8596 req-35b82749-61ad-406f-b2d7-56276efcf95f service nova] Creating event network-changed:abedbf31-d88b-46bc-a1ef-33a68dcc3b21 for instance 0faad1c9-0b0d-44af-92cb-dd0acd61c755 on hv-cinder-85127 Jul 30 05:05:45.886575 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-e4d30bd6-d4a9-4c91-8fca-04257daa8596 req-35b82749-61ad-406f-b2d7-56276efcf95f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038014 Jul 30 05:05:45.887950 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 511/1068] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Jul 30 05:05:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 05:05:47.490546 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-f09ab3bb-c09a-4cd1-9db7-b7c5194f3b5a tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:05:47.491580 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-f09ab3bb-c09a-4cd1-9db7-b7c5194f3b5a tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] [instance: 0faad1c9-0b0d-44af-92cb-dd0acd61c755] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:05:47.498981 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f09ab3bb-c09a-4cd1-9db7-b7c5194f3b5a tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:47.499442 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f09ab3bb-c09a-4cd1-9db7-b7c5194f3b5a tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:47.500195 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f09ab3bb-c09a-4cd1-9db7-b7c5194f3b5a tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:47.500813 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f09ab3bb-c09a-4cd1-9db7-b7c5194f3b5a tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:47.607983 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.objects.instance [None req-f09ab3bb-c09a-4cd1-9db7-b7c5194f3b5a tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lazy-loading 'services' on Instance uuid 0faad1c9-0b0d-44af-92cb-dd0acd61c755 {{(pid=117886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 05:05:47.703282 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-f09ab3bb-c09a-4cd1-9db7-b7c5194f3b5a tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755/os-volume_attachments/bf46e11b-0d9e-403c-9a47-aae4c5b55cbc" status: 202 len: 0 microversion: 2.1 time: 0.218492 Jul 30 05:05:47.703868 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 558/1069] 10.222.0.20 () {58 vars in 1416 bytes} [Sat Jul 30 05:05:47 2022] DELETE /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755/os-volume_attachments/bf46e11b-0d9e-403c-9a47-aae4c5b55cbc => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 05:05:47.716333 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-538bcade-b8c1-425b-83d4-256d661b04f6 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:05:47.723604 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-538bcade-b8c1-425b-83d4-256d661b04f6 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] [instance: 0faad1c9-0b0d-44af-92cb-dd0acd61c755] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:05:47.736739 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-538bcade-b8c1-425b-83d4-256d661b04f6 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:47.737675 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-538bcade-b8c1-425b-83d4-256d661b04f6 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:47.738793 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-538bcade-b8c1-425b-83d4-256d661b04f6 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:47.740078 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-538bcade-b8c1-425b-83d4-256d661b04f6 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:47.775739 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-538bcade-b8c1-425b-83d4-256d661b04f6 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] 10.222.0.20 "GET /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066493 Jul 30 05:05:47.776721 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 512/1070] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Jul 30 05:05:47 2022] GET /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 05:05:47.910640 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-4343fb13-c839-49c2-9690-385fdcb32da9 req-cb0312d3-5ec0-47d8-99b0-b684d095031d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0faad1c9-0b0d-44af-92cb-dd0acd61c755", "tag": "abedbf31-d88b-46bc-a1ef-33a68dcc3b21"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:05:47.922747 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-4343fb13-c839-49c2-9690-385fdcb32da9 req-cb0312d3-5ec0-47d8-99b0-b684d095031d service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:47.922990 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-4343fb13-c839-49c2-9690-385fdcb32da9 req-cb0312d3-5ec0-47d8-99b0-b684d095031d service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:47.934530 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-4343fb13-c839-49c2-9690-385fdcb32da9 req-cb0312d3-5ec0-47d8-99b0-b684d095031d service nova] Creating event network-changed:abedbf31-d88b-46bc-a1ef-33a68dcc3b21 for instance 0faad1c9-0b0d-44af-92cb-dd0acd61c755 on hv-cinder-85127 Jul 30 05:05:47.941385 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-4343fb13-c839-49c2-9690-385fdcb32da9 req-cb0312d3-5ec0-47d8-99b0-b684d095031d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035652 Jul 30 05:05:47.942226 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 559/1071] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Jul 30 05:05:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 05:05:48.788076 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-acef816d-5cf4-40a9-8054-85688d71adad tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:05:48.790246 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-acef816d-5cf4-40a9-8054-85688d71adad tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] [instance: 0faad1c9-0b0d-44af-92cb-dd0acd61c755] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:05:48.797220 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-acef816d-5cf4-40a9-8054-85688d71adad tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:48.798054 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-acef816d-5cf4-40a9-8054-85688d71adad tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:48.798888 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-acef816d-5cf4-40a9-8054-85688d71adad tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:48.799430 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-acef816d-5cf4-40a9-8054-85688d71adad tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:48.832150 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-acef816d-5cf4-40a9-8054-85688d71adad tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] 10.222.0.20 "GET /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048234 Jul 30 05:05:48.832912 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 513/1072] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Jul 30 05:05:48 2022] GET /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 30 05:05:48.844300 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-46e9cbb2-8bc8-4aa5-b489-dd6b28c4b560 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:05:48.844888 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-46e9cbb2-8bc8-4aa5-b489-dd6b28c4b560 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] [instance: 0faad1c9-0b0d-44af-92cb-dd0acd61c755] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:05:48.852044 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-46e9cbb2-8bc8-4aa5-b489-dd6b28c4b560 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:48.852514 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-46e9cbb2-8bc8-4aa5-b489-dd6b28c4b560 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:48.853559 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-46e9cbb2-8bc8-4aa5-b489-dd6b28c4b560 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:48.854271 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-46e9cbb2-8bc8-4aa5-b489-dd6b28c4b560 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:48.933403 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.wsgi [None req-46e9cbb2-8bc8-4aa5-b489-dd6b28c4b560 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] HTTP exception thrown: Instance 0faad1c9-0b0d-44af-92cb-dd0acd61c755 is not attached to volume bf46e11b-0d9e-403c-9a47-aae4c5b55cbc Jul 30 05:05:48.948618 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-46e9cbb2-8bc8-4aa5-b489-dd6b28c4b560 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Request method failure captured: Jul 30 05:05:48.948618 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: request: DELETE /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755/os-volume_attachments/bf46e11b-0d9e-403c-9a47-aae4c5b55cbc HTTP/1.1 Jul 30 05:05:48.948618 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Accept: application/json Jul 30 05:05:48.948618 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Accept-Encoding: identity Jul 30 05:05:48.948618 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Connection: close Jul 30 05:05:48.948618 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Content-Length: 0 Jul 30 05:05:48.948618 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Content-Type: application/json Jul 30 05:05:48.948618 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Host: 10.222.0.20 Jul 30 05:05:48.948618 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Openstack-System-Scope: None Jul 30 05:05:48.948618 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: User-Agent: python-urllib3/1.26.10 Jul 30 05:05:48.948618 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Auth-Token: gAAAAABi5LuUJmKoEo2WvMnn89bpxp-FotiAnkLfrFbYuajkT9lIRub4JWR0o-6dRvhQvMUJgjmUzZXxf_-uCIMrsixsoltx9r4Ln8DWJ07YwhcA-P37nZ4Ryn041DJMp0Msgaft9ToXCaYuxxzAk6Oyej2twuzCncw_CuZyI6DHf-ZsxSpGosk Jul 30 05:05:48.948618 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Domain-Id: None Jul 30 05:05:48.948618 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Domain-Name: None Jul 30 05:05:48.948618 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Identity-Status: Confirmed Jul 30 05:05:48.948618 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Is-Admin-Project: True Jul 30 05:05:48.948618 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Project-Domain-Id: default Jul 30 05:05:48.948618 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Project-Domain-Name: Default Jul 30 05:05:48.948618 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Project-Id: abbb209e2c194596bb3e8b9a6880646e Jul 30 05:05:48.948618 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Project-Name: tempest-TestMinimumBasicScenario-1723319149 Jul 30 05:05:48.948618 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Role: member,reader Jul 30 05:05:48.948618 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Roles: member,reader Jul 30 05:05:48.950097 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abbb209e2c194596bb3e8b9a6880646e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abbb209e2c194596bb3e8b9a6880646e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_abbb209e2c194596bb3e8b9a6880646e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/abbb209e2c194596bb3e8b9a6880646e"}]}] Jul 30 05:05:48.950097 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Tenant: tempest-TestMinimumBasicScenario-1723319149 Jul 30 05:05:48.950097 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Tenant-Id: abbb209e2c194596bb3e8b9a6880646e Jul 30 05:05:48.950097 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1723319149 Jul 30 05:05:48.950097 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User: tempest-TestMinimumBasicScenario-1723319149-project Jul 30 05:05:48.950097 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User-Domain-Id: default Jul 30 05:05:48.950097 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User-Domain-Name: Default Jul 30 05:05:48.950097 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User-Id: 42d3708ddfcc491cb366054dcd5f8881 Jul 30 05:05:48.950097 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User-Name: tempest-TestMinimumBasicScenario-1723319149-project Jul 30 05:05:48.950097 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: method: > Jul 30 05:05:48.950097 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: exception: Instance 0faad1c9-0b0d-44af-92cb-dd0acd61c755 is not attached to volume bf46e11b-0d9e-403c-9a47-aae4c5b55cbc Jul 30 05:05:48.951117 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: action_args: {'server_id': '0faad1c9-0b0d-44af-92cb-dd0acd61c755', 'id': 'bf46e11b-0d9e-403c-9a47-aae4c5b55cbc'} Jul 30 05:05:48.951117 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 05:05:48.951117 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:05:48.951117 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 30 05:05:48.951117 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 30 05:05:48.951117 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 30 05:05:48.951117 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 30 05:05:48.951117 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 30 05:05:48.951117 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 30 05:05:48.951117 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id bf46e11b-0d9e-403c-9a47-aae4c5b55cbc. Jul 30 05:05:48.951117 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 05:05:48.951117 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 05:05:48.951117 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 05:05:48.951117 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:05:48.951117 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 05:05:48.951117 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 05:05:48.951117 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 05:05:48.951117 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 05:05:48.951117 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 05:05:48.952330 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 05:05:48.952330 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 30 05:05:48.952330 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 30 05:05:48.952330 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0faad1c9-0b0d-44af-92cb-dd0acd61c755 is not attached to volume bf46e11b-0d9e-403c-9a47-aae4c5b55cbc Jul 30 05:05:48.952330 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 05:05:48.952330 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 05:05:48.952330 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 05:05:48.952330 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:05:48.952330 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 05:05:48.952330 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 05:05:48.952330 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 05:05:48.952330 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 05:05:48.952330 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0faad1c9-0b0d-44af-92cb-dd0acd61c755 is not attached to volume bf46e11b-0d9e-403c-9a47-aae4c5b55cbc Jul 30 05:05:48.952330 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 05:05:48.952330 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-46e9cbb2-8bc8-4aa5-b489-dd6b28c4b560 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Returning 404 to user: Instance 0faad1c9-0b0d-44af-92cb-dd0acd61c755 is not attached to volume bf46e11b-0d9e-403c-9a47-aae4c5b55cbc {{(pid=117886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 05:05:48.953370 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-46e9cbb2-8bc8-4aa5-b489-dd6b28c4b560 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755/os-volume_attachments/bf46e11b-0d9e-403c-9a47-aae4c5b55cbc" status: 404 len: 154 microversion: 2.1 time: 0.110720 Jul 30 05:05:48.953370 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 560/1073] 10.222.0.20 () {58 vars in 1416 bytes} [Sat Jul 30 05:05:48 2022] DELETE /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755/os-volume_attachments/bf46e11b-0d9e-403c-9a47-aae4c5b55cbc => generated 154 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 30 05:05:50.131969 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-4d6594ce-fb75-43da-a60c-1602508b6f94 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:05:50.132483 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-4d6594ce-fb75-43da-a60c-1602508b6f94 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] [instance: 0faad1c9-0b0d-44af-92cb-dd0acd61c755] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:05:50.142940 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4d6594ce-fb75-43da-a60c-1602508b6f94 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:50.143607 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4d6594ce-fb75-43da-a60c-1602508b6f94 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:50.144484 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4d6594ce-fb75-43da-a60c-1602508b6f94 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:50.144928 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4d6594ce-fb75-43da-a60c-1602508b6f94 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:50.177504 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-4d6594ce-fb75-43da-a60c-1602508b6f94 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] [instance: 0faad1c9-0b0d-44af-92cb-dd0acd61c755] Going to try to terminate instance {{(pid=117885) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 05:05:50.265948 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-4d6594ce-fb75-43da-a60c-1602508b6f94 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755" status: 204 len: 0 microversion: 2.1 time: 0.139057 Jul 30 05:05:50.266821 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 514/1074] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Jul 30 05:05:50 2022] DELETE /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 05:05:50.277125 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-2c3511e9-b1b6-4dbd-bf74-7f571da7d5b3 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:05:50.277758 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-2c3511e9-b1b6-4dbd-bf74-7f571da7d5b3 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] [instance: 0faad1c9-0b0d-44af-92cb-dd0acd61c755] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:05:50.298453 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2c3511e9-b1b6-4dbd-bf74-7f571da7d5b3 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:50.299667 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2c3511e9-b1b6-4dbd-bf74-7f571da7d5b3 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:50.301735 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2c3511e9-b1b6-4dbd-bf74-7f571da7d5b3 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:50.302233 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-2c3511e9-b1b6-4dbd-bf74-7f571da7d5b3 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:50.497519 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-2c3511e9-b1b6-4dbd-bf74-7f571da7d5b3 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42d3708ddfcc491cb366054dcd5f8881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abbb209e2c194596bb3e8b9a6880646e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:05:50.506161 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-2c3511e9-b1b6-4dbd-bf74-7f571da7d5b3 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] 10.222.0.20 "GET /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755" status: 200 len: 1553 microversion: 2.1 time: 0.233178 Jul 30 05:05:50.506766 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 561/1075] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:05:50 2022] GET /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755 => generated 1553 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:05:51.535124 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-175eb864-601e-4b90-9aff-4c0b857c2044 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:05:51.536724 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-175eb864-601e-4b90-9aff-4c0b857c2044 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] [instance: 0faad1c9-0b0d-44af-92cb-dd0acd61c755] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:05:51.547196 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-175eb864-601e-4b90-9aff-4c0b857c2044 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:51.547930 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-175eb864-601e-4b90-9aff-4c0b857c2044 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:51.549840 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-175eb864-601e-4b90-9aff-4c0b857c2044 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:51.550496 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-175eb864-601e-4b90-9aff-4c0b857c2044 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:51.803857 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-175eb864-601e-4b90-9aff-4c0b857c2044 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42d3708ddfcc491cb366054dcd5f8881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abbb209e2c194596bb3e8b9a6880646e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:05:51.815130 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-175eb864-601e-4b90-9aff-4c0b857c2044 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] 10.222.0.20 "GET /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755" status: 200 len: 1553 microversion: 2.1 time: 0.283781 Jul 30 05:05:51.819402 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 515/1076] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:05:51 2022] GET /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755 => generated 1553 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:05:52.837019 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-e2effc32-2c6f-4b45-bd6a-52465894d003 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:05:52.837760 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-e2effc32-2c6f-4b45-bd6a-52465894d003 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] [instance: 0faad1c9-0b0d-44af-92cb-dd0acd61c755] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:05:52.844510 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e2effc32-2c6f-4b45-bd6a-52465894d003 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:52.845220 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e2effc32-2c6f-4b45-bd6a-52465894d003 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:52.846365 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e2effc32-2c6f-4b45-bd6a-52465894d003 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:52.847004 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e2effc32-2c6f-4b45-bd6a-52465894d003 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:52.911400 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-1fb82b9b-9afe-4005-be7f-7fdfbd9eff48 req-20a31445-c6b3-461b-880d-8cd079a87765 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0faad1c9-0b0d-44af-92cb-dd0acd61c755", "name": "network-vif-deleted", "tag": "abedbf31-d88b-46bc-a1ef-33a68dcc3b21"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:05:52.929981 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-1fb82b9b-9afe-4005-be7f-7fdfbd9eff48 req-20a31445-c6b3-461b-880d-8cd079a87765 service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:52.931551 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-1fb82b9b-9afe-4005-be7f-7fdfbd9eff48 req-20a31445-c6b3-461b-880d-8cd079a87765 service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:52.944733 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-e2effc32-2c6f-4b45-bd6a-52465894d003 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42d3708ddfcc491cb366054dcd5f8881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abbb209e2c194596bb3e8b9a6880646e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:05:52.952889 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-e2effc32-2c6f-4b45-bd6a-52465894d003 tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] 10.222.0.20 "GET /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755" status: 200 len: 1511 microversion: 2.1 time: 0.119615 Jul 30 05:05:52.970229 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 562/1077] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:05:52 2022] GET /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755 => generated 1511 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:05:52.974741 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-1fb82b9b-9afe-4005-be7f-7fdfbd9eff48 req-20a31445-c6b3-461b-880d-8cd079a87765 service nova] Creating event network-vif-deleted:abedbf31-d88b-46bc-a1ef-33a68dcc3b21 for instance 0faad1c9-0b0d-44af-92cb-dd0acd61c755 on hv-cinder-85127 Jul 30 05:05:52.980605 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-1fb82b9b-9afe-4005-be7f-7fdfbd9eff48 req-20a31445-c6b3-461b-880d-8cd079a87765 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086367 Jul 30 05:05:52.981518 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 516/1078] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Jul 30 05:05:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 05:05:53.681710 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-b1920d42-172a-47ee-a87c-1f44ba94bb1e tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Action: 'create', calling method: .version_select at 0x7f2daf6fbaf0>, body: {"keypair": {"name": "tempest-keypair-876609958", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFOTzFcYMcw4rpTJmazl1so37bQhvl78HT8QBr9zKAUxoyCAwk//6pycWD09EcJ/LeSEgFjKeed/haxvg85jUhCa9RV3n2k7/T76kuqA0K3JhjZKIajL6fs/e2TO7EAyTw=="}} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:05:53.698110 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.quota [None req-b1920d42-172a-47ee-a87c-1f44ba94bb1e tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Getting quotas for project d9f8c70dc5de488698a8ab775c618088. Resources: {'key_pairs'} {{(pid=117886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 05:05:53.702279 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.quota [None req-b1920d42-172a-47ee-a87c-1f44ba94bb1e tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Getting quotas for user 3a805f5dec66484c8d950b6bc52e3e03 and project d9f8c70dc5de488698a8ab775c618088. Resources: {'key_pairs'} {{(pid=117886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 05:05:53.725207 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-b1920d42-172a-47ee-a87c-1f44ba94bb1e tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.172880 Jul 30 05:05:53.725822 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 563/1079] 10.222.0.20 () {60 vars in 1159 bytes} [Sat Jul 30 05:05:53 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 05:05:53.978927 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-0b092b29-bb1b-42c0-b657-7f781dcacf5a tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:05:53.981299 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-0b092b29-bb1b-42c0-b657-7f781dcacf5a tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] [instance: 0faad1c9-0b0d-44af-92cb-dd0acd61c755] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:05:53.989481 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0b092b29-bb1b-42c0-b657-7f781dcacf5a tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:53.990014 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0b092b29-bb1b-42c0-b657-7f781dcacf5a tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:53.991004 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0b092b29-bb1b-42c0-b657-7f781dcacf5a tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:53.991546 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0b092b29-bb1b-42c0-b657-7f781dcacf5a tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:54.007678 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.wsgi [None req-0b092b29-bb1b-42c0-b657-7f781dcacf5a tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] HTTP exception thrown: Instance 0faad1c9-0b0d-44af-92cb-dd0acd61c755 could not be found. Jul 30 05:05:54.009874 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-0b092b29-bb1b-42c0-b657-7f781dcacf5a tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Request method failure captured: Jul 30 05:05:54.009874 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: request: GET /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755 HTTP/1.1 Jul 30 05:05:54.009874 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Accept: application/json Jul 30 05:05:54.009874 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Accept-Encoding: identity Jul 30 05:05:54.009874 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Connection: close Jul 30 05:05:54.009874 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Content-Length: 0 Jul 30 05:05:54.009874 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Content-Type: application/json Jul 30 05:05:54.009874 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Host: 10.222.0.20 Jul 30 05:05:54.009874 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Openstack-System-Scope: None Jul 30 05:05:54.009874 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: User-Agent: python-urllib3/1.26.10 Jul 30 05:05:54.009874 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Auth-Token: gAAAAABi5LuUJmKoEo2WvMnn89bpxp-FotiAnkLfrFbYuajkT9lIRub4JWR0o-6dRvhQvMUJgjmUzZXxf_-uCIMrsixsoltx9r4Ln8DWJ07YwhcA-P37nZ4Ryn041DJMp0Msgaft9ToXCaYuxxzAk6Oyej2twuzCncw_CuZyI6DHf-ZsxSpGosk Jul 30 05:05:54.009874 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Domain-Id: None Jul 30 05:05:54.009874 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Domain-Name: None Jul 30 05:05:54.009874 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Identity-Status: Confirmed Jul 30 05:05:54.009874 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Is-Admin-Project: True Jul 30 05:05:54.009874 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Domain-Id: default Jul 30 05:05:54.009874 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Domain-Name: Default Jul 30 05:05:54.009874 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Id: abbb209e2c194596bb3e8b9a6880646e Jul 30 05:05:54.009874 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Name: tempest-TestMinimumBasicScenario-1723319149 Jul 30 05:05:54.009874 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Role: member,reader Jul 30 05:05:54.009874 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Roles: member,reader Jul 30 05:05:54.011669 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abbb209e2c194596bb3e8b9a6880646e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/abbb209e2c194596bb3e8b9a6880646e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_abbb209e2c194596bb3e8b9a6880646e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/abbb209e2c194596bb3e8b9a6880646e"}]}] Jul 30 05:05:54.011669 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Tenant: tempest-TestMinimumBasicScenario-1723319149 Jul 30 05:05:54.011669 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Tenant-Id: abbb209e2c194596bb3e8b9a6880646e Jul 30 05:05:54.011669 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1723319149 Jul 30 05:05:54.011669 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User: tempest-TestMinimumBasicScenario-1723319149-project Jul 30 05:05:54.011669 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Domain-Id: default Jul 30 05:05:54.011669 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Domain-Name: Default Jul 30 05:05:54.011669 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Id: 42d3708ddfcc491cb366054dcd5f8881 Jul 30 05:05:54.011669 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Name: tempest-TestMinimumBasicScenario-1723319149-project Jul 30 05:05:54.011669 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: method: > Jul 30 05:05:54.011669 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: exception: Instance 0faad1c9-0b0d-44af-92cb-dd0acd61c755 could not be found. Jul 30 05:05:54.011669 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: action_args: {'id': '0faad1c9-0b0d-44af-92cb-dd0acd61c755'} Jul 30 05:05:54.012583 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 05:05:54.012583 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:05:54.012583 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 05:05:54.012583 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 05:05:54.012583 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 05:05:54.012583 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 05:05:54.012583 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 05:05:54.012583 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 05:05:54.012583 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 05:05:54.012583 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 05:05:54.012583 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0faad1c9-0b0d-44af-92cb-dd0acd61c755 could not be found. Jul 30 05:05:54.012583 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:05:54.012583 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 05:05:54.012583 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:05:54.012583 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:05:54.012583 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 05:05:54.012583 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 05:05:54.012583 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 05:05:54.012583 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 05:05:54.012583 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 05:05:54.014104 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 05:05:54.014104 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 05:05:54.014104 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 05:05:54.014104 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 05:05:54.014104 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 05:05:54.014104 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 05:05:54.014104 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 05:05:54.014104 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0faad1c9-0b0d-44af-92cb-dd0acd61c755 could not be found. Jul 30 05:05:54.014104 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:05:54.014104 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 05:05:54.014104 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:05:54.014104 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:05:54.014104 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 05:05:54.014104 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 05:05:54.014104 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 05:05:54.014104 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 05:05:54.014104 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0faad1c9-0b0d-44af-92cb-dd0acd61c755 could not be found. Jul 30 05:05:54.014104 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:05:54.016196 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-0b092b29-bb1b-42c0-b657-7f781dcacf5a tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Returning 404 to user: Instance 0faad1c9-0b0d-44af-92cb-dd0acd61c755 could not be found. {{(pid=117885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 05:05:54.017047 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-0b092b29-bb1b-42c0-b657-7f781dcacf5a tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] 10.222.0.20 "GET /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755" status: 404 len: 111 microversion: 2.1 time: 0.043523 Jul 30 05:05:54.017742 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 517/1080] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:05:53 2022] GET /compute/v2.1/servers/0faad1c9-0b0d-44af-92cb-dd0acd61c755 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 05:05:54.027459 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-b7903da7-3d9b-4854-af37-2656b94361db tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] Calling method '.version_select at 0x7f2db4034d30>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:05:54.055291 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-b7903da7-3d9b-4854-af37-2656b94361db tempest-TestMinimumBasicScenario-1723319149 tempest-TestMinimumBasicScenario-1723319149-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-561025293" status: 202 len: 0 microversion: 2.1 time: 0.032941 Jul 30 05:05:54.055911 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 564/1081] 10.222.0.20 () {58 vars in 1269 bytes} [Sat Jul 30 05:05:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-561025293 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 30 05:05:55.172227 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-befa4d12-2eed-4fc1-ae45-ad8988cf247c tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-557728998", "imageRef": "d6a9c8e1-ecb9-4603-bb88-2b0d46ac2387", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "94989f7f-6c27-4232-af89-2c1914199605"}], "security_groups": [{"name": "tempest-securitygroup--1414368977"}], "key_name": "tempest-keypair-876609958", "user_data": "}} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:05:55.332249 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.network.neutron [None req-befa4d12-2eed-4fc1-ae45-ad8988cf247c tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] validate_networks() for [('94989f7f-6c27-4232-af89-2c1914199605', None, None, None, None, None)] {{(pid=117885) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 05:05:56.264192 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-befa4d12-2eed-4fc1-ae45-ad8988cf247c tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Flavor limits 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 05:05:56.265307 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-befa4d12-2eed-4fc1-ae45-ad8988cf247c tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Image limits 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 05:05:56.265769 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-befa4d12-2eed-4fc1-ae45-ad8988cf247c tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Flavor pref 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 05:05:56.266419 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-befa4d12-2eed-4fc1-ae45-ad8988cf247c tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Image pref 0:0:0 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 05:05:56.266898 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.virt.hardware [None req-befa4d12-2eed-4fc1-ae45-ad8988cf247c tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 05:05:56.277278 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-befa4d12-2eed-4fc1-ae45-ad8988cf247c tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:56.277725 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-befa4d12-2eed-4fc1-ae45-ad8988cf247c tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:56.278568 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-befa4d12-2eed-4fc1-ae45-ad8988cf247c tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:56.279007 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-befa4d12-2eed-4fc1-ae45-ad8988cf247c tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:56.301755 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.quota [None req-befa4d12-2eed-4fc1-ae45-ad8988cf247c tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Getting quotas for project d9f8c70dc5de488698a8ab775c618088. Resources: {'ram', 'cores', 'instances'} {{(pid=117885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 05:05:56.315631 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.quota [None req-befa4d12-2eed-4fc1-ae45-ad8988cf247c tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Getting quotas for user 3a805f5dec66484c8d950b6bc52e3e03 and project d9f8c70dc5de488698a8ab775c618088. Resources: {'ram', 'cores', 'instances'} {{(pid=117885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 05:05:56.336467 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-befa4d12-2eed-4fc1-ae45-ad8988cf247c tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Going to run 1 instances... {{(pid=117885) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 05:05:56.340830 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-befa4d12-2eed-4fc1-ae45-ad8988cf247c tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] [instance: fb65e17c-681e-4949-a673-03130f14c360] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d6a9c8e1-ecb9-4603-bb88-2b0d46ac2387',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 05:05:56.388083 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-befa4d12-2eed-4fc1-ae45-ad8988cf247c tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.220329 Jul 30 05:05:56.389096 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 518/1082] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Jul 30 05:05:55 2022] POST /compute/v2.1/servers => generated 402 bytes in 1222 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 05:05:56.400967 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-021f5e30-633e-4dd7-90da-d3ba49e1ecc8 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:05:56.401593 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-021f5e30-633e-4dd7-90da-d3ba49e1ecc8 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] [instance: fb65e17c-681e-4949-a673-03130f14c360] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:05:56.472053 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-021f5e30-633e-4dd7-90da-d3ba49e1ecc8 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a805f5dec66484c8d950b6bc52e3e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f8c70dc5de488698a8ab775c618088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:05:56.479022 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-021f5e30-633e-4dd7-90da-d3ba49e1ecc8 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] 10.222.0.20 "GET /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360" status: 200 len: 1236 microversion: 2.1 time: 0.081963 Jul 30 05:05:56.493421 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 565/1083] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:05:56 2022] GET /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360 => generated 1236 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:05:57.509477 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-2b1bd89c-4513-469c-acb2-fb5f3d06dab3 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:05:57.515306 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-2b1bd89c-4513-469c-acb2-fb5f3d06dab3 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] [instance: fb65e17c-681e-4949-a673-03130f14c360] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:05:57.530897 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2b1bd89c-4513-469c-acb2-fb5f3d06dab3 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:57.531348 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2b1bd89c-4513-469c-acb2-fb5f3d06dab3 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:57.548662 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2b1bd89c-4513-469c-acb2-fb5f3d06dab3 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:57.549447 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2b1bd89c-4513-469c-acb2-fb5f3d06dab3 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:57.685550 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-2b1bd89c-4513-469c-acb2-fb5f3d06dab3 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a805f5dec66484c8d950b6bc52e3e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f8c70dc5de488698a8ab775c618088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:05:57.695903 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-2b1bd89c-4513-469c-acb2-fb5f3d06dab3 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] 10.222.0.20 "GET /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360" status: 200 len: 1288 microversion: 2.1 time: 0.197186 Jul 30 05:05:57.697057 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 519/1084] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:05:57 2022] GET /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360 => generated 1288 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:05:58.718025 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-6393d538-13d4-406d-b7ab-47f472531e87 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:05:58.719902 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-6393d538-13d4-406d-b7ab-47f472531e87 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] [instance: fb65e17c-681e-4949-a673-03130f14c360] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:05:58.736210 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6393d538-13d4-406d-b7ab-47f472531e87 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:58.740110 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6393d538-13d4-406d-b7ab-47f472531e87 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:58.741186 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6393d538-13d4-406d-b7ab-47f472531e87 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:05:58.741633 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6393d538-13d4-406d-b7ab-47f472531e87 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:05:58.980432 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-6393d538-13d4-406d-b7ab-47f472531e87 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a805f5dec66484c8d950b6bc52e3e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f8c70dc5de488698a8ab775c618088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:05:58.994068 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-6393d538-13d4-406d-b7ab-47f472531e87 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] 10.222.0.20 "GET /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360" status: 200 len: 1362 microversion: 2.1 time: 0.280386 Jul 30 05:05:59.011037 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 566/1085] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:05:58 2022] GET /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360 => generated 1362 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:06:00.024398 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-44ae23a2-26ea-4a5f-b799-24c0f597e2bb tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:06:00.025446 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-44ae23a2-26ea-4a5f-b799-24c0f597e2bb tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] [instance: fb65e17c-681e-4949-a673-03130f14c360] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:06:00.031932 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-44ae23a2-26ea-4a5f-b799-24c0f597e2bb tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:06:00.032465 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-44ae23a2-26ea-4a5f-b799-24c0f597e2bb tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:06:00.033243 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-44ae23a2-26ea-4a5f-b799-24c0f597e2bb tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:06:00.033668 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-44ae23a2-26ea-4a5f-b799-24c0f597e2bb tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:06:00.336781 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-44ae23a2-26ea-4a5f-b799-24c0f597e2bb tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a805f5dec66484c8d950b6bc52e3e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f8c70dc5de488698a8ab775c618088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:06:00.344184 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-44ae23a2-26ea-4a5f-b799-24c0f597e2bb tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] 10.222.0.20 "GET /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360" status: 200 len: 1362 microversion: 2.1 time: 0.323659 Jul 30 05:06:00.344760 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 520/1086] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:06:00 2022] GET /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360 => generated 1362 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:06:00.451677 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-ec326334-43a2-4e22-ae76-ed411761393d req-3c7adf15-fd42-4856-b190-83a453267ba1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb65e17c-681e-4949-a673-03130f14c360", "tag": "267d1818-566d-49c4-b27c-b194d59ebd4c"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:06:00.461614 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-ec326334-43a2-4e22-ae76-ed411761393d req-3c7adf15-fd42-4856-b190-83a453267ba1 service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:06:00.462060 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-ec326334-43a2-4e22-ae76-ed411761393d req-3c7adf15-fd42-4856-b190-83a453267ba1 service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:06:00.472970 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-ec326334-43a2-4e22-ae76-ed411761393d req-3c7adf15-fd42-4856-b190-83a453267ba1 service nova] Creating event network-changed:267d1818-566d-49c4-b27c-b194d59ebd4c for instance fb65e17c-681e-4949-a673-03130f14c360 on hv-cinder-85127 Jul 30 05:06:00.478463 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-ec326334-43a2-4e22-ae76-ed411761393d req-3c7adf15-fd42-4856-b190-83a453267ba1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030347 Jul 30 05:06:00.479075 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 567/1087] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Jul 30 05:06:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 05:06:01.365949 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-1993b8ce-dcf3-45f6-9dd0-a7435204b354 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:06:01.367832 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-1993b8ce-dcf3-45f6-9dd0-a7435204b354 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] [instance: fb65e17c-681e-4949-a673-03130f14c360] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:06:01.380918 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1993b8ce-dcf3-45f6-9dd0-a7435204b354 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:06:01.381415 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1993b8ce-dcf3-45f6-9dd0-a7435204b354 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:06:01.382191 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1993b8ce-dcf3-45f6-9dd0-a7435204b354 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:06:01.382791 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1993b8ce-dcf3-45f6-9dd0-a7435204b354 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:06:01.620032 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-1993b8ce-dcf3-45f6-9dd0-a7435204b354 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a805f5dec66484c8d950b6bc52e3e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f8c70dc5de488698a8ab775c618088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:06:01.628897 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-1993b8ce-dcf3-45f6-9dd0-a7435204b354 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] 10.222.0.20 "GET /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360" status: 200 len: 1362 microversion: 2.1 time: 0.266966 Jul 30 05:06:01.644432 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 521/1088] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:06:01 2022] GET /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360 => generated 1362 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:06:02.652150 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-e261f4f5-2aec-4bf3-8fab-6052bb03ff0b tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:06:02.652872 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-e261f4f5-2aec-4bf3-8fab-6052bb03ff0b tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] [instance: fb65e17c-681e-4949-a673-03130f14c360] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:06:02.659862 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e261f4f5-2aec-4bf3-8fab-6052bb03ff0b tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:06:02.660367 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e261f4f5-2aec-4bf3-8fab-6052bb03ff0b tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:06:02.661228 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e261f4f5-2aec-4bf3-8fab-6052bb03ff0b tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:06:02.661771 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e261f4f5-2aec-4bf3-8fab-6052bb03ff0b tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:06:02.967757 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-e261f4f5-2aec-4bf3-8fab-6052bb03ff0b tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a805f5dec66484c8d950b6bc52e3e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f8c70dc5de488698a8ab775c618088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:06:02.977350 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-e261f4f5-2aec-4bf3-8fab-6052bb03ff0b tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] 10.222.0.20 "GET /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360" status: 200 len: 1362 microversion: 2.1 time: 0.329975 Jul 30 05:06:02.991529 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 568/1089] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:06:02 2022] GET /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360 => generated 1362 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:06:03.998334 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-4f0ea73f-e891-4aa7-86fb-3af965f42521 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:06:03.998976 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-4f0ea73f-e891-4aa7-86fb-3af965f42521 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] [instance: fb65e17c-681e-4949-a673-03130f14c360] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:06:04.005465 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4f0ea73f-e891-4aa7-86fb-3af965f42521 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:06:04.006089 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4f0ea73f-e891-4aa7-86fb-3af965f42521 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:06:04.006804 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4f0ea73f-e891-4aa7-86fb-3af965f42521 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:06:04.007361 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-4f0ea73f-e891-4aa7-86fb-3af965f42521 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:06:04.159887 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-4f0ea73f-e891-4aa7-86fb-3af965f42521 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a805f5dec66484c8d950b6bc52e3e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f8c70dc5de488698a8ab775c618088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:06:04.163945 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:06:04.170220 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-4f0ea73f-e891-4aa7-86fb-3af965f42521 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] 10.222.0.20 "GET /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360" status: 200 len: 1362 microversion: 2.1 time: 0.175719 Jul 30 05:06:04.171004 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 522/1090] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:06:03 2022] GET /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360 => generated 1362 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:06:05.191449 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-75d19edd-b963-43b8-aec5-c07bb3797f2e tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:06:05.191999 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-75d19edd-b963-43b8-aec5-c07bb3797f2e tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] [instance: fb65e17c-681e-4949-a673-03130f14c360] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:06:05.198429 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-75d19edd-b963-43b8-aec5-c07bb3797f2e tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:06:05.198957 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-75d19edd-b963-43b8-aec5-c07bb3797f2e tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:06:05.199943 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-75d19edd-b963-43b8-aec5-c07bb3797f2e tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:06:05.200380 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-75d19edd-b963-43b8-aec5-c07bb3797f2e tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:06:05.327925 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-75d19edd-b963-43b8-aec5-c07bb3797f2e tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a805f5dec66484c8d950b6bc52e3e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f8c70dc5de488698a8ab775c618088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:06:05.335293 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-75d19edd-b963-43b8-aec5-c07bb3797f2e tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] 10.222.0.20 "GET /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360" status: 200 len: 1362 microversion: 2.1 time: 0.147815 Jul 30 05:06:05.335863 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 569/1091] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:06:05 2022] GET /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360 => generated 1362 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:06:06.357732 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-c2ed0536-cb39-4b2e-84e3-fa146e94e568 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:06:06.358342 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-c2ed0536-cb39-4b2e-84e3-fa146e94e568 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] [instance: fb65e17c-681e-4949-a673-03130f14c360] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:06:06.360579 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell0:SELECT=2 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:06:06.361228 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell0:SELECT=6 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:06:06.369306 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c2ed0536-cb39-4b2e-84e3-fa146e94e568 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:06:06.369854 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c2ed0536-cb39-4b2e-84e3-fa146e94e568 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:06:06.370641 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c2ed0536-cb39-4b2e-84e3-fa146e94e568 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:06:06.371078 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-c2ed0536-cb39-4b2e-84e3-fa146e94e568 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:06:06.497624 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-c2ed0536-cb39-4b2e-84e3-fa146e94e568 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a805f5dec66484c8d950b6bc52e3e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f8c70dc5de488698a8ab775c618088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:06:06.505153 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-c2ed0536-cb39-4b2e-84e3-fa146e94e568 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] 10.222.0.20 "GET /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360" status: 200 len: 1362 microversion: 2.1 time: 0.152289 Jul 30 05:06:06.505746 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 523/1092] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:06:06 2022] GET /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:06:07.526331 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-ac1499dc-cadc-44d8-b16e-4edfa7bcb62c tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:06:07.526988 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-ac1499dc-cadc-44d8-b16e-4edfa7bcb62c tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] [instance: fb65e17c-681e-4949-a673-03130f14c360] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:06:07.529355 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell0:SELECT=6 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:06:07.530202 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:06:07.536028 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ac1499dc-cadc-44d8-b16e-4edfa7bcb62c tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:06:07.536480 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ac1499dc-cadc-44d8-b16e-4edfa7bcb62c tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:06:07.537249 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ac1499dc-cadc-44d8-b16e-4edfa7bcb62c tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:06:07.537687 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ac1499dc-cadc-44d8-b16e-4edfa7bcb62c tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:06:07.542316 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=74,nova_cell1:INSERT=1 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:06:07.675865 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-ac1499dc-cadc-44d8-b16e-4edfa7bcb62c tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a805f5dec66484c8d950b6bc52e3e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f8c70dc5de488698a8ab775c618088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:06:07.683296 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-ac1499dc-cadc-44d8-b16e-4edfa7bcb62c tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] 10.222.0.20 "GET /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360" status: 200 len: 1362 microversion: 2.1 time: 0.160870 Jul 30 05:06:07.683853 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 570/1093] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:06:07 2022] GET /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:06:08.705245 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-f41e0d95-18b0-4057-91a1-b73685856b14 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:06:08.706505 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-f41e0d95-18b0-4057-91a1-b73685856b14 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] [instance: fb65e17c-681e-4949-a673-03130f14c360] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:06:08.709530 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:06:08.714959 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f41e0d95-18b0-4057-91a1-b73685856b14 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:06:08.715482 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f41e0d95-18b0-4057-91a1-b73685856b14 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:06:08.716436 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f41e0d95-18b0-4057-91a1-b73685856b14 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:06:08.717030 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f41e0d95-18b0-4057-91a1-b73685856b14 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:06:08.772870 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-8bed0940-1832-4fac-a4a1-377d45410cba req-c3b49810-d9fb-494b-9bac-061ee9ccf8fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb65e17c-681e-4949-a673-03130f14c360", "name": "network-vif-plugged", "status": "completed", "tag": "267d1818-566d-49c4-b27c-b194d59ebd4c"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:06:08.789944 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-8bed0940-1832-4fac-a4a1-377d45410cba req-c3b49810-d9fb-494b-9bac-061ee9ccf8fd service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:06:08.790721 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-8bed0940-1832-4fac-a4a1-377d45410cba req-c3b49810-d9fb-494b-9bac-061ee9ccf8fd service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:06:08.805365 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-8bed0940-1832-4fac-a4a1-377d45410cba req-c3b49810-d9fb-494b-9bac-061ee9ccf8fd service nova] Creating event network-vif-plugged:267d1818-566d-49c4-b27c-b194d59ebd4c for instance fb65e17c-681e-4949-a673-03130f14c360 on hv-cinder-85127 Jul 30 05:06:08.811193 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-8bed0940-1832-4fac-a4a1-377d45410cba req-c3b49810-d9fb-494b-9bac-061ee9ccf8fd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043042 Jul 30 05:06:08.812013 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 571/1094] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Jul 30 05:06:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 05:06:08.897154 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-f41e0d95-18b0-4057-91a1-b73685856b14 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a805f5dec66484c8d950b6bc52e3e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f8c70dc5de488698a8ab775c618088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:06:08.904848 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-f41e0d95-18b0-4057-91a1-b73685856b14 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] 10.222.0.20 "GET /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360" status: 200 len: 1362 microversion: 2.1 time: 0.203839 Jul 30 05:06:08.905433 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 524/1095] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:06:08 2022] GET /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360 => generated 1362 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:06:09.927038 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-80ea5c14-c125-4248-8149-cc726cb2057e tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:06:09.927749 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-80ea5c14-c125-4248-8149-cc726cb2057e tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] [instance: fb65e17c-681e-4949-a673-03130f14c360] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:06:09.934703 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-80ea5c14-c125-4248-8149-cc726cb2057e tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:06:09.935161 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-80ea5c14-c125-4248-8149-cc726cb2057e tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:06:09.935960 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-80ea5c14-c125-4248-8149-cc726cb2057e tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:06:09.936398 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-80ea5c14-c125-4248-8149-cc726cb2057e tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:06:10.121148 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-80ea5c14-c125-4248-8149-cc726cb2057e tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a805f5dec66484c8d950b6bc52e3e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f8c70dc5de488698a8ab775c618088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:06:10.129501 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-80ea5c14-c125-4248-8149-cc726cb2057e tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] 10.222.0.20 "GET /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360" status: 200 len: 1362 microversion: 2.1 time: 0.207722 Jul 30 05:06:10.138316 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 572/1096] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:06:09 2022] GET /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360 => generated 1362 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:06:11.152106 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-d81f9c88-fdad-45e7-aab1-14d8c009f00d tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:06:11.152720 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-d81f9c88-fdad-45e7-aab1-14d8c009f00d tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] [instance: fb65e17c-681e-4949-a673-03130f14c360] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:06:11.159279 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d81f9c88-fdad-45e7-aab1-14d8c009f00d tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:06:11.159729 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d81f9c88-fdad-45e7-aab1-14d8c009f00d tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:06:11.160491 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d81f9c88-fdad-45e7-aab1-14d8c009f00d tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:06:11.160927 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d81f9c88-fdad-45e7-aab1-14d8c009f00d tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:06:11.291288 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-d81f9c88-fdad-45e7-aab1-14d8c009f00d tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a805f5dec66484c8d950b6bc52e3e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f8c70dc5de488698a8ab775c618088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:06:11.299038 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-d81f9c88-fdad-45e7-aab1-14d8c009f00d tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] 10.222.0.20 "GET /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360" status: 200 len: 1547 microversion: 2.1 time: 0.150817 Jul 30 05:06:11.300227 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 525/1097] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:06:11 2022] GET /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360 => generated 1547 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:06:11.320699 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-77492c73-bf34-422e-9839-a820973ac324 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:06:11.321202 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-77492c73-bf34-422e-9839-a820973ac324 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] [instance: fb65e17c-681e-4949-a673-03130f14c360] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:06:11.327590 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-77492c73-bf34-422e-9839-a820973ac324 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:06:11.328042 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-77492c73-bf34-422e-9839-a820973ac324 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:06:11.328805 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-77492c73-bf34-422e-9839-a820973ac324 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:06:11.329242 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-77492c73-bf34-422e-9839-a820973ac324 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:06:11.406324 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-77492c73-bf34-422e-9839-a820973ac324 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] 10.222.0.20 "GET /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089392 Jul 30 05:06:11.406954 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 573/1098] 10.222.0.20 () {58 vars in 1275 bytes} [Sat Jul 30 05:06:11 2022] GET /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 05:06:12.336515 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-e314bb6d-c11e-4305-98bf-f80cd4517cfa req-f6f096e8-0836-41f7-9de7-9c6aa0ede67e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb65e17c-681e-4949-a673-03130f14c360", "tag": "267d1818-566d-49c4-b27c-b194d59ebd4c"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:06:12.347597 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-e314bb6d-c11e-4305-98bf-f80cd4517cfa req-f6f096e8-0836-41f7-9de7-9c6aa0ede67e service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:06:12.348143 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-e314bb6d-c11e-4305-98bf-f80cd4517cfa req-f6f096e8-0836-41f7-9de7-9c6aa0ede67e service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:06:12.360162 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-e314bb6d-c11e-4305-98bf-f80cd4517cfa req-f6f096e8-0836-41f7-9de7-9c6aa0ede67e service nova] Creating event network-changed:267d1818-566d-49c4-b27c-b194d59ebd4c for instance fb65e17c-681e-4949-a673-03130f14c360 on hv-cinder-85127 Jul 30 05:06:12.366737 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-e314bb6d-c11e-4305-98bf-f80cd4517cfa req-f6f096e8-0836-41f7-9de7-9c6aa0ede67e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034038 Jul 30 05:06:12.367485 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 526/1099] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Jul 30 05:06:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 05:06:46.074037 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 30 05:06:46.074525 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Sat Jul 30 05:06:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 30 05:06:48.501186 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_api:SELECT=7 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:06:48.501943 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=17 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:06:48.506355 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-e04b4a37-2ece-45da-a205-db390dc312bb tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:06:48.506883 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-e04b4a37-2ece-45da-a205-db390dc312bb tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] [instance: fb65e17c-681e-4949-a673-03130f14c360] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:06:48.513780 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e04b4a37-2ece-45da-a205-db390dc312bb tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:06:48.514233 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e04b4a37-2ece-45da-a205-db390dc312bb tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:06:48.515038 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e04b4a37-2ece-45da-a205-db390dc312bb tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:06:48.515499 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e04b4a37-2ece-45da-a205-db390dc312bb tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:06:48.539996 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-e04b4a37-2ece-45da-a205-db390dc312bb tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] 10.222.0.20 "GET /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360/ips" status: 200 len: 144 microversion: 2.1 time: 0.040128 Jul 30 05:06:48.540491 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 574/1100] 10.222.0.20 () {58 vars in 1248 bytes} [Sat Jul 30 05:06:48 2022] GET /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360/ips => generated 144 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 05:06:52.902593 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_api:SELECT=5 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:06:52.903326 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell1:SELECT=20 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:06:52.908043 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-8e1eec1e-c12e-43a7-ad24-ee3e012c7ab5 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c7ada58c-1786-4844-9df9-79a2289c7b34"}} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:06:52.910551 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-8e1eec1e-c12e-43a7-ad24-ee3e012c7ab5 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] [instance: fb65e17c-681e-4949-a673-03130f14c360] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:06:52.917369 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8e1eec1e-c12e-43a7-ad24-ee3e012c7ab5 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:06:52.917799 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8e1eec1e-c12e-43a7-ad24-ee3e012c7ab5 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:06:52.918845 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8e1eec1e-c12e-43a7-ad24-ee3e012c7ab5 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:06:52.919277 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8e1eec1e-c12e-43a7-ad24-ee3e012c7ab5 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:06:53.159357 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-8e1eec1e-c12e-43a7-ad24-ee3e012c7ab5 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] 10.222.0.20 "POST /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.257507 Jul 30 05:06:53.159989 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 527/1101] 10.222.0.20 () {60 vars in 1323 bytes} [Sat Jul 30 05:06:52 2022] POST /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360/os-volume_attachments => generated 194 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 05:06:55.181754 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-b7cb2228-58c9-4390-abf4-d60d548cd874 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1002989052", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-275234029", "security_groups": [{"name": "tempest-secgroup-smoke-9281366"}], "block_device_mapping_v2": [{"uuid": "881d419b-7194-4b20-85bc-6e7ed35575b1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "05de52c4-affb-4a9e-aea7-e8e105567377"}]}} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:06:55.298745 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.network.neutron [None req-b7cb2228-58c9-4390-abf4-d60d548cd874 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] validate_networks() for [('05de52c4-affb-4a9e-aea7-e8e105567377', None, None, None, None, None)] {{(pid=117886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 05:06:55.666528 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-b7cb2228-58c9-4390-abf4-d60d548cd874 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Flavor limits 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 05:06:55.666992 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-b7cb2228-58c9-4390-abf4-d60d548cd874 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Image limits 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 05:06:55.667464 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-b7cb2228-58c9-4390-abf4-d60d548cd874 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Flavor pref 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 05:06:55.667877 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-b7cb2228-58c9-4390-abf4-d60d548cd874 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Image pref 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 05:06:55.668555 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-b7cb2228-58c9-4390-abf4-d60d548cd874 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 05:06:55.678291 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b7cb2228-58c9-4390-abf4-d60d548cd874 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:06:55.678778 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b7cb2228-58c9-4390-abf4-d60d548cd874 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:06:55.679584 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b7cb2228-58c9-4390-abf4-d60d548cd874 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:06:55.680058 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b7cb2228-58c9-4390-abf4-d60d548cd874 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:06:55.697946 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.quota [None req-b7cb2228-58c9-4390-abf4-d60d548cd874 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Getting quotas for project db365a6a9f6041a7a8749fd1a1e3d488. Resources: {'ram', 'cores', 'instances'} {{(pid=117886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 05:06:55.701926 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.quota [None req-b7cb2228-58c9-4390-abf4-d60d548cd874 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Getting quotas for user 407ad282edd74fb1adf62fb63306779c and project db365a6a9f6041a7a8749fd1a1e3d488. Resources: {'ram', 'cores', 'instances'} {{(pid=117886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 05:06:55.763720 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-b7cb2228-58c9-4390-abf4-d60d548cd874 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Going to run 1 instances... {{(pid=117886) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 05:06:55.765818 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-b7cb2228-58c9-4390-abf4-d60d548cd874 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] [instance: 2044debc-6b41-413e-ac3d-89a4cca33a13] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='881d419b-7194-4b20-85bc-6e7ed35575b1',volume_size=None,volume_type=None)] {{(pid=117886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 05:06:55.894543 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-b7cb2228-58c9-4390-abf4-d60d548cd874 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.716505 Jul 30 05:06:55.895184 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 575/1102] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Jul 30 05:06:55 2022] POST /compute/v2.1/servers => generated 403 bytes in 718 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 05:06:55.907098 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-abf9d52b-ae4c-41ac-81ab-d33777710d98 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:06:55.907916 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-abf9d52b-ae4c-41ac-81ab-d33777710d98 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] [instance: 2044debc-6b41-413e-ac3d-89a4cca33a13] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:06:55.968105 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-abf9d52b-ae4c-41ac-81ab-d33777710d98 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407ad282edd74fb1adf62fb63306779c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db365a6a9f6041a7a8749fd1a1e3d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:06:55.975357 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-abf9d52b-ae4c-41ac-81ab-d33777710d98 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] 10.222.0.20 "GET /compute/v2.1/servers/2044debc-6b41-413e-ac3d-89a4cca33a13" status: 200 len: 1094 microversion: 2.1 time: 0.073196 Jul 30 05:06:55.976093 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 528/1103] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:06:55 2022] GET /compute/v2.1/servers/2044debc-6b41-413e-ac3d-89a4cca33a13 => generated 1094 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:06:56.996966 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-d28a3198-db94-4fd9-8ba6-19422d6d99ea tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:06:56.997588 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-d28a3198-db94-4fd9-8ba6-19422d6d99ea tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] [instance: 2044debc-6b41-413e-ac3d-89a4cca33a13] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:06:57.005180 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d28a3198-db94-4fd9-8ba6-19422d6d99ea tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:06:57.005637 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d28a3198-db94-4fd9-8ba6-19422d6d99ea tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:06:57.006446 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d28a3198-db94-4fd9-8ba6-19422d6d99ea tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:06:57.006970 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d28a3198-db94-4fd9-8ba6-19422d6d99ea tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:06:57.073441 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-d28a3198-db94-4fd9-8ba6-19422d6d99ea tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407ad282edd74fb1adf62fb63306779c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db365a6a9f6041a7a8749fd1a1e3d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:06:57.082132 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-d28a3198-db94-4fd9-8ba6-19422d6d99ea tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] 10.222.0.20 "GET /compute/v2.1/servers/2044debc-6b41-413e-ac3d-89a4cca33a13" status: 200 len: 1200 microversion: 2.1 time: 0.089540 Jul 30 05:06:57.082733 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 576/1104] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:06:56 2022] GET /compute/v2.1/servers/2044debc-6b41-413e-ac3d-89a4cca33a13 => generated 1200 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:06:58.104984 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-65e77e70-8eae-453a-8cf0-f4d992c9a3ce tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:06:58.105571 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-65e77e70-8eae-453a-8cf0-f4d992c9a3ce tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] [instance: 2044debc-6b41-413e-ac3d-89a4cca33a13] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:06:58.113094 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-65e77e70-8eae-453a-8cf0-f4d992c9a3ce tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:06:58.113540 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-65e77e70-8eae-453a-8cf0-f4d992c9a3ce tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:06:58.114314 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-65e77e70-8eae-453a-8cf0-f4d992c9a3ce tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:06:58.114776 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-65e77e70-8eae-453a-8cf0-f4d992c9a3ce tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:06:58.323615 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-65e77e70-8eae-453a-8cf0-f4d992c9a3ce tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407ad282edd74fb1adf62fb63306779c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db365a6a9f6041a7a8749fd1a1e3d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:06:58.332119 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-65e77e70-8eae-453a-8cf0-f4d992c9a3ce tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] 10.222.0.20 "GET /compute/v2.1/servers/2044debc-6b41-413e-ac3d-89a4cca33a13" status: 200 len: 1275 microversion: 2.1 time: 0.231023 Jul 30 05:06:58.332629 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 529/1105] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:06:58 2022] GET /compute/v2.1/servers/2044debc-6b41-413e-ac3d-89a4cca33a13 => generated 1275 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:06:58.405444 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-6137bcfd-9af0-4d86-a6a0-59ad6d396468 req-c1fdb92f-9a21-4e83-93d0-36af13d8e30d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2044debc-6b41-413e-ac3d-89a4cca33a13", "tag": "d47fd3ca-b5c7-44be-a749-9b228fae6174"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:06:58.416067 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-6137bcfd-9af0-4d86-a6a0-59ad6d396468 req-c1fdb92f-9a21-4e83-93d0-36af13d8e30d service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:06:58.416511 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-6137bcfd-9af0-4d86-a6a0-59ad6d396468 req-c1fdb92f-9a21-4e83-93d0-36af13d8e30d service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:06:58.428725 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-6137bcfd-9af0-4d86-a6a0-59ad6d396468 req-c1fdb92f-9a21-4e83-93d0-36af13d8e30d service nova] Creating event network-changed:d47fd3ca-b5c7-44be-a749-9b228fae6174 for instance 2044debc-6b41-413e-ac3d-89a4cca33a13 on hv-cinder-85127 Jul 30 05:06:58.433607 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-6137bcfd-9af0-4d86-a6a0-59ad6d396468 req-c1fdb92f-9a21-4e83-93d0-36af13d8e30d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031840 Jul 30 05:06:58.434210 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 577/1106] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Jul 30 05:06:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 05:06:59.353070 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-df0180d6-8e8b-4643-8785-98ac15d1296a tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:06:59.353708 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-df0180d6-8e8b-4643-8785-98ac15d1296a tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] [instance: 2044debc-6b41-413e-ac3d-89a4cca33a13] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:06:59.360228 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-df0180d6-8e8b-4643-8785-98ac15d1296a tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:06:59.360698 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-df0180d6-8e8b-4643-8785-98ac15d1296a tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:06:59.362133 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-df0180d6-8e8b-4643-8785-98ac15d1296a tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:06:59.362642 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-df0180d6-8e8b-4643-8785-98ac15d1296a tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:06:59.493296 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-df0180d6-8e8b-4643-8785-98ac15d1296a tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407ad282edd74fb1adf62fb63306779c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db365a6a9f6041a7a8749fd1a1e3d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:06:59.500618 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-df0180d6-8e8b-4643-8785-98ac15d1296a tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] 10.222.0.20 "GET /compute/v2.1/servers/2044debc-6b41-413e-ac3d-89a4cca33a13" status: 200 len: 1275 microversion: 2.1 time: 0.151533 Jul 30 05:06:59.501180 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 530/1107] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:06:59 2022] GET /compute/v2.1/servers/2044debc-6b41-413e-ac3d-89a4cca33a13 => generated 1275 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:07:00.522814 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-e0106ef1-537a-45cc-9f0e-c5af99d742d3 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:07:00.523554 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-e0106ef1-537a-45cc-9f0e-c5af99d742d3 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] [instance: 2044debc-6b41-413e-ac3d-89a4cca33a13] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:07:00.529783 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e0106ef1-537a-45cc-9f0e-c5af99d742d3 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:07:00.530251 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e0106ef1-537a-45cc-9f0e-c5af99d742d3 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:07:00.531054 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e0106ef1-537a-45cc-9f0e-c5af99d742d3 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:07:00.531504 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e0106ef1-537a-45cc-9f0e-c5af99d742d3 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:07:00.678470 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-e0106ef1-537a-45cc-9f0e-c5af99d742d3 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407ad282edd74fb1adf62fb63306779c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db365a6a9f6041a7a8749fd1a1e3d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:07:00.687996 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-e0106ef1-537a-45cc-9f0e-c5af99d742d3 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] 10.222.0.20 "GET /compute/v2.1/servers/2044debc-6b41-413e-ac3d-89a4cca33a13" status: 200 len: 1275 microversion: 2.1 time: 0.170361 Jul 30 05:07:00.688775 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 578/1108] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:07:00 2022] GET /compute/v2.1/servers/2044debc-6b41-413e-ac3d-89a4cca33a13 => generated 1275 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:07:00.721472 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-e9eab4e0-1e4b-481c-bd96-68fbad823265 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:07:00.728069 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e9eab4e0-1e4b-481c-bd96-68fbad823265 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:07:00.728531 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e9eab4e0-1e4b-481c-bd96-68fbad823265 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:07:00.788954 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-e9eab4e0-1e4b-481c-bd96-68fbad823265 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] [instance: fb65e17c-681e-4949-a673-03130f14c360] Going to try to stop instance {{(pid=117885) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Jul 30 05:07:00.832039 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-e9eab4e0-1e4b-481c-bd96-68fbad823265 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] 10.222.0.20 "POST /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360/action" status: 202 len: 0 microversion: 2.1 time: 0.114383 Jul 30 05:07:00.832626 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 531/1109] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Jul 30 05:07:00 2022] POST /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 05:07:00.840975 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-b273a2ef-789e-4cc1-9e09-45a1c7224a05 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:07:00.841531 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-b273a2ef-789e-4cc1-9e09-45a1c7224a05 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] [instance: fb65e17c-681e-4949-a673-03130f14c360] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:07:00.847758 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b273a2ef-789e-4cc1-9e09-45a1c7224a05 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:07:00.848157 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b273a2ef-789e-4cc1-9e09-45a1c7224a05 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:07:00.848943 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b273a2ef-789e-4cc1-9e09-45a1c7224a05 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:07:00.849375 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b273a2ef-789e-4cc1-9e09-45a1c7224a05 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:07:00.979194 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-b273a2ef-789e-4cc1-9e09-45a1c7224a05 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a805f5dec66484c8d950b6bc52e3e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f8c70dc5de488698a8ab775c618088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:07:00.987785 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-b273a2ef-789e-4cc1-9e09-45a1c7224a05 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] 10.222.0.20 "GET /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360" status: 200 len: 1721 microversion: 2.1 time: 0.150835 Jul 30 05:07:00.988342 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 579/1110] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:07:00 2022] GET /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360 => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:07:01.714129 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-59c5f25d-294a-439e-bee7-58abf90d4782 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:07:01.714854 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-59c5f25d-294a-439e-bee7-58abf90d4782 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] [instance: 2044debc-6b41-413e-ac3d-89a4cca33a13] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:07:01.721095 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-59c5f25d-294a-439e-bee7-58abf90d4782 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:07:01.721538 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-59c5f25d-294a-439e-bee7-58abf90d4782 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:07:01.722295 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-59c5f25d-294a-439e-bee7-58abf90d4782 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:07:01.722767 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-59c5f25d-294a-439e-bee7-58abf90d4782 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:07:01.851631 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-59c5f25d-294a-439e-bee7-58abf90d4782 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407ad282edd74fb1adf62fb63306779c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db365a6a9f6041a7a8749fd1a1e3d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:07:01.859194 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-59c5f25d-294a-439e-bee7-58abf90d4782 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] 10.222.0.20 "GET /compute/v2.1/servers/2044debc-6b41-413e-ac3d-89a4cca33a13" status: 200 len: 1263 microversion: 2.1 time: 0.149265 Jul 30 05:07:01.859766 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 532/1111] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:07:01 2022] GET /compute/v2.1/servers/2044debc-6b41-413e-ac3d-89a4cca33a13 => generated 1263 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:07:02.009251 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-ad67cdd6-9a48-4778-ba4c-67bd9da3bc5b tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:07:02.009783 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-ad67cdd6-9a48-4778-ba4c-67bd9da3bc5b tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] [instance: fb65e17c-681e-4949-a673-03130f14c360] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:07:02.016236 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ad67cdd6-9a48-4778-ba4c-67bd9da3bc5b tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:07:02.016690 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ad67cdd6-9a48-4778-ba4c-67bd9da3bc5b tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:07:02.017466 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ad67cdd6-9a48-4778-ba4c-67bd9da3bc5b tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:07:02.017917 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ad67cdd6-9a48-4778-ba4c-67bd9da3bc5b tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:07:02.148899 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-ad67cdd6-9a48-4778-ba4c-67bd9da3bc5b tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a805f5dec66484c8d950b6bc52e3e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f8c70dc5de488698a8ab775c618088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:07:02.156734 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-ad67cdd6-9a48-4778-ba4c-67bd9da3bc5b tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] 10.222.0.20 "GET /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360" status: 200 len: 1721 microversion: 2.1 time: 0.151480 Jul 30 05:07:02.157523 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 580/1112] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:07:02 2022] GET /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:07:02.880627 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-78dfb9dd-0e92-4110-83aa-07f6c7194115 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:07:02.881185 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-78dfb9dd-0e92-4110-83aa-07f6c7194115 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] [instance: 2044debc-6b41-413e-ac3d-89a4cca33a13] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:07:02.887685 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-78dfb9dd-0e92-4110-83aa-07f6c7194115 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:07:02.888142 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-78dfb9dd-0e92-4110-83aa-07f6c7194115 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:07:02.888910 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-78dfb9dd-0e92-4110-83aa-07f6c7194115 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:07:02.889354 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-78dfb9dd-0e92-4110-83aa-07f6c7194115 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:07:03.023309 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-78dfb9dd-0e92-4110-83aa-07f6c7194115 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407ad282edd74fb1adf62fb63306779c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db365a6a9f6041a7a8749fd1a1e3d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:07:03.030878 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-78dfb9dd-0e92-4110-83aa-07f6c7194115 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] 10.222.0.20 "GET /compute/v2.1/servers/2044debc-6b41-413e-ac3d-89a4cca33a13" status: 200 len: 1263 microversion: 2.1 time: 0.154188 Jul 30 05:07:03.031442 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 533/1113] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:07:02 2022] GET /compute/v2.1/servers/2044debc-6b41-413e-ac3d-89a4cca33a13 => generated 1263 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:07:03.179177 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-62a9c4ca-96bc-4f21-b6c1-354efdde9418 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:07:03.179719 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-62a9c4ca-96bc-4f21-b6c1-354efdde9418 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] [instance: fb65e17c-681e-4949-a673-03130f14c360] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:07:03.186060 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-62a9c4ca-96bc-4f21-b6c1-354efdde9418 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:07:03.186540 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-62a9c4ca-96bc-4f21-b6c1-354efdde9418 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:07:03.187296 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-62a9c4ca-96bc-4f21-b6c1-354efdde9418 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:07:03.187729 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-62a9c4ca-96bc-4f21-b6c1-354efdde9418 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:07:03.314934 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-62a9c4ca-96bc-4f21-b6c1-354efdde9418 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a805f5dec66484c8d950b6bc52e3e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f8c70dc5de488698a8ab775c618088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:07:03.322732 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-62a9c4ca-96bc-4f21-b6c1-354efdde9418 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] 10.222.0.20 "GET /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360" status: 200 len: 1721 microversion: 2.1 time: 0.147462 Jul 30 05:07:03.323291 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 581/1114] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:07:03 2022] GET /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360 => generated 1721 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:07:04.051198 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-0d44e040-15b9-4948-b240-26854509682b tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:07:04.051817 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-0d44e040-15b9-4948-b240-26854509682b tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] [instance: 2044debc-6b41-413e-ac3d-89a4cca33a13] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:07:04.058172 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0d44e040-15b9-4948-b240-26854509682b tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:07:04.058660 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0d44e040-15b9-4948-b240-26854509682b tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:07:04.059421 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0d44e040-15b9-4948-b240-26854509682b tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:07:04.059854 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0d44e040-15b9-4948-b240-26854509682b tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:07:04.189372 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-0d44e040-15b9-4948-b240-26854509682b tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407ad282edd74fb1adf62fb63306779c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db365a6a9f6041a7a8749fd1a1e3d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:07:04.196756 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-0d44e040-15b9-4948-b240-26854509682b tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] 10.222.0.20 "GET /compute/v2.1/servers/2044debc-6b41-413e-ac3d-89a4cca33a13" status: 200 len: 1263 microversion: 2.1 time: 0.149558 Jul 30 05:07:04.197315 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 534/1115] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:07:04 2022] GET /compute/v2.1/servers/2044debc-6b41-413e-ac3d-89a4cca33a13 => generated 1263 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:07:04.345018 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-65f02a0a-4024-4840-9e74-45256966a4df tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:07:04.345573 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-65f02a0a-4024-4840-9e74-45256966a4df tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] [instance: fb65e17c-681e-4949-a673-03130f14c360] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:07:04.352037 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-65f02a0a-4024-4840-9e74-45256966a4df tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:07:04.352491 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-65f02a0a-4024-4840-9e74-45256966a4df tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:07:04.353261 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-65f02a0a-4024-4840-9e74-45256966a4df tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:07:04.353701 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-65f02a0a-4024-4840-9e74-45256966a4df tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:07:04.479701 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-65f02a0a-4024-4840-9e74-45256966a4df tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a805f5dec66484c8d950b6bc52e3e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f8c70dc5de488698a8ab775c618088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:07:04.487955 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-65f02a0a-4024-4840-9e74-45256966a4df tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] 10.222.0.20 "GET /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360" status: 200 len: 1721 microversion: 2.1 time: 0.146911 Jul 30 05:07:04.488516 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 582/1116] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:07:04 2022] GET /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360 => generated 1721 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:07:05.217914 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-d1d2f7f4-06e8-4abb-b91b-6530f1ecb64f tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:07:05.218593 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-d1d2f7f4-06e8-4abb-b91b-6530f1ecb64f tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] [instance: 2044debc-6b41-413e-ac3d-89a4cca33a13] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:07:05.225617 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d1d2f7f4-06e8-4abb-b91b-6530f1ecb64f tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:07:05.226075 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d1d2f7f4-06e8-4abb-b91b-6530f1ecb64f tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:07:05.226939 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d1d2f7f4-06e8-4abb-b91b-6530f1ecb64f tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:07:05.227387 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d1d2f7f4-06e8-4abb-b91b-6530f1ecb64f tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:07:05.357622 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-d1d2f7f4-06e8-4abb-b91b-6530f1ecb64f tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407ad282edd74fb1adf62fb63306779c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db365a6a9f6041a7a8749fd1a1e3d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:07:05.365835 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-d1d2f7f4-06e8-4abb-b91b-6530f1ecb64f tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] 10.222.0.20 "GET /compute/v2.1/servers/2044debc-6b41-413e-ac3d-89a4cca33a13" status: 200 len: 1263 microversion: 2.1 time: 0.151780 Jul 30 05:07:05.366401 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 535/1117] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:07:05 2022] GET /compute/v2.1/servers/2044debc-6b41-413e-ac3d-89a4cca33a13 => generated 1263 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:07:05.508616 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-f77f18d1-8887-4cec-a255-dec157c944a8 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:07:05.509221 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-f77f18d1-8887-4cec-a255-dec157c944a8 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] [instance: fb65e17c-681e-4949-a673-03130f14c360] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:07:05.515748 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f77f18d1-8887-4cec-a255-dec157c944a8 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:07:05.516195 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f77f18d1-8887-4cec-a255-dec157c944a8 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:07:05.516945 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f77f18d1-8887-4cec-a255-dec157c944a8 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:07:05.517996 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f77f18d1-8887-4cec-a255-dec157c944a8 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:07:05.648143 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-f77f18d1-8887-4cec-a255-dec157c944a8 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a805f5dec66484c8d950b6bc52e3e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f8c70dc5de488698a8ab775c618088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:07:05.656021 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-f77f18d1-8887-4cec-a255-dec157c944a8 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] 10.222.0.20 "GET /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360" status: 200 len: 1721 microversion: 2.1 time: 0.151174 Jul 30 05:07:05.656583 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 583/1118] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:07:05 2022] GET /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360 => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:07:06.386851 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-66dc9fd8-bbde-476a-bb7e-342075e068a4 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:07:06.387388 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-66dc9fd8-bbde-476a-bb7e-342075e068a4 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] [instance: 2044debc-6b41-413e-ac3d-89a4cca33a13] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:07:06.389298 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell0:SELECT=2 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:07:06.395815 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-66dc9fd8-bbde-476a-bb7e-342075e068a4 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:07:06.396264 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-66dc9fd8-bbde-476a-bb7e-342075e068a4 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:07:06.397021 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-66dc9fd8-bbde-476a-bb7e-342075e068a4 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:07:06.397457 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-66dc9fd8-bbde-476a-bb7e-342075e068a4 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:07:06.531405 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-66dc9fd8-bbde-476a-bb7e-342075e068a4 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407ad282edd74fb1adf62fb63306779c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db365a6a9f6041a7a8749fd1a1e3d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:07:06.539735 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-66dc9fd8-bbde-476a-bb7e-342075e068a4 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] 10.222.0.20 "GET /compute/v2.1/servers/2044debc-6b41-413e-ac3d-89a4cca33a13" status: 200 len: 1263 microversion: 2.1 time: 0.156777 Jul 30 05:07:06.540308 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 536/1119] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:07:06 2022] GET /compute/v2.1/servers/2044debc-6b41-413e-ac3d-89a4cca33a13 => generated 1263 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:07:06.677641 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-53f939d1-844d-4403-a858-2235e12dccc3 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:07:06.678227 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-53f939d1-844d-4403-a858-2235e12dccc3 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] [instance: fb65e17c-681e-4949-a673-03130f14c360] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:07:06.680190 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell0:SELECT=2 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:07:06.680975 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell0:SELECT=6 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:07:06.687772 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-53f939d1-844d-4403-a858-2235e12dccc3 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:07:06.688255 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-53f939d1-844d-4403-a858-2235e12dccc3 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:07:06.689716 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-53f939d1-844d-4403-a858-2235e12dccc3 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:07:06.690116 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-53f939d1-844d-4403-a858-2235e12dccc3 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:07:06.819444 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-53f939d1-844d-4403-a858-2235e12dccc3 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a805f5dec66484c8d950b6bc52e3e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f8c70dc5de488698a8ab775c618088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:07:06.827369 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-53f939d1-844d-4403-a858-2235e12dccc3 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] 10.222.0.20 "GET /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360" status: 200 len: 1721 microversion: 2.1 time: 0.154251 Jul 30 05:07:06.827943 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 584/1120] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:07:06 2022] GET /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:07:07.560688 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-b6b02a58-461f-4940-bf24-4651793fb8e3 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:07:07.561307 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-b6b02a58-461f-4940-bf24-4651793fb8e3 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] [instance: 2044debc-6b41-413e-ac3d-89a4cca33a13] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:07:07.568427 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b6b02a58-461f-4940-bf24-4651793fb8e3 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:07:07.568882 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b6b02a58-461f-4940-bf24-4651793fb8e3 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:07:07.569650 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b6b02a58-461f-4940-bf24-4651793fb8e3 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:07:07.570093 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b6b02a58-461f-4940-bf24-4651793fb8e3 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:07:07.697691 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-b6b02a58-461f-4940-bf24-4651793fb8e3 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407ad282edd74fb1adf62fb63306779c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db365a6a9f6041a7a8749fd1a1e3d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:07:07.705541 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-b6b02a58-461f-4940-bf24-4651793fb8e3 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] 10.222.0.20 "GET /compute/v2.1/servers/2044debc-6b41-413e-ac3d-89a4cca33a13" status: 200 len: 1263 microversion: 2.1 time: 0.148708 Jul 30 05:07:07.706116 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 537/1121] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:07:07 2022] GET /compute/v2.1/servers/2044debc-6b41-413e-ac3d-89a4cca33a13 => generated 1263 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:07:07.849156 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-ac4a67e6-e13a-4473-a9e6-8b3ad87f24f7 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:07:07.849719 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-ac4a67e6-e13a-4473-a9e6-8b3ad87f24f7 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] [instance: fb65e17c-681e-4949-a673-03130f14c360] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:07:07.856248 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ac4a67e6-e13a-4473-a9e6-8b3ad87f24f7 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:07:07.856704 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ac4a67e6-e13a-4473-a9e6-8b3ad87f24f7 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:07:07.857643 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ac4a67e6-e13a-4473-a9e6-8b3ad87f24f7 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:07:07.857908 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ac4a67e6-e13a-4473-a9e6-8b3ad87f24f7 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:07:07.989290 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-ac4a67e6-e13a-4473-a9e6-8b3ad87f24f7 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a805f5dec66484c8d950b6bc52e3e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f8c70dc5de488698a8ab775c618088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:07:07.997095 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-ac4a67e6-e13a-4473-a9e6-8b3ad87f24f7 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] 10.222.0.20 "GET /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360" status: 200 len: 1721 microversion: 2.1 time: 0.151893 Jul 30 05:07:07.997682 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 585/1122] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:07:07 2022] GET /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:07:08.726318 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-bf2cf55a-3ed3-44ce-bfc2-8db622095590 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:07:08.727044 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-bf2cf55a-3ed3-44ce-bfc2-8db622095590 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] [instance: 2044debc-6b41-413e-ac3d-89a4cca33a13] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:07:08.733819 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-bf2cf55a-3ed3-44ce-bfc2-8db622095590 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:07:08.734275 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-bf2cf55a-3ed3-44ce-bfc2-8db622095590 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:07:08.735071 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-bf2cf55a-3ed3-44ce-bfc2-8db622095590 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:07:08.735512 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-bf2cf55a-3ed3-44ce-bfc2-8db622095590 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:07:08.867825 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-bf2cf55a-3ed3-44ce-bfc2-8db622095590 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407ad282edd74fb1adf62fb63306779c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db365a6a9f6041a7a8749fd1a1e3d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:07:08.875501 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-bf2cf55a-3ed3-44ce-bfc2-8db622095590 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] 10.222.0.20 "GET /compute/v2.1/servers/2044debc-6b41-413e-ac3d-89a4cca33a13" status: 200 len: 1263 microversion: 2.1 time: 0.153153 Jul 30 05:07:08.877606 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 538/1123] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:07:08 2022] GET /compute/v2.1/servers/2044debc-6b41-413e-ac3d-89a4cca33a13 => generated 1263 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:07:09.020336 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-34fb4461-fc55-48bb-837c-3f64f5751ecf tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:07:09.021010 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-34fb4461-fc55-48bb-837c-3f64f5751ecf tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] [instance: fb65e17c-681e-4949-a673-03130f14c360] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:07:09.027636 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-34fb4461-fc55-48bb-837c-3f64f5751ecf tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:07:09.028090 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-34fb4461-fc55-48bb-837c-3f64f5751ecf tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:07:09.028872 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-34fb4461-fc55-48bb-837c-3f64f5751ecf tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:07:09.029313 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-34fb4461-fc55-48bb-837c-3f64f5751ecf tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:07:09.165832 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-34fb4461-fc55-48bb-837c-3f64f5751ecf tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a805f5dec66484c8d950b6bc52e3e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f8c70dc5de488698a8ab775c618088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:07:09.174905 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-34fb4461-fc55-48bb-837c-3f64f5751ecf tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] 10.222.0.20 "GET /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360" status: 200 len: 1721 microversion: 2.1 time: 0.159600 Jul 30 05:07:09.175458 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 586/1124] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:07:09 2022] GET /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:07:09.897760 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-35264e50-ba1d-4dac-9048-13ea5f7ee78e tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:07:09.898371 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-35264e50-ba1d-4dac-9048-13ea5f7ee78e tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] [instance: 2044debc-6b41-413e-ac3d-89a4cca33a13] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:07:09.904832 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-35264e50-ba1d-4dac-9048-13ea5f7ee78e tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:07:09.905285 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-35264e50-ba1d-4dac-9048-13ea5f7ee78e tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:07:09.906042 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-35264e50-ba1d-4dac-9048-13ea5f7ee78e tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:07:09.906503 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-35264e50-ba1d-4dac-9048-13ea5f7ee78e tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:07:10.037691 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-35264e50-ba1d-4dac-9048-13ea5f7ee78e tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407ad282edd74fb1adf62fb63306779c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db365a6a9f6041a7a8749fd1a1e3d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:07:10.045466 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-35264e50-ba1d-4dac-9048-13ea5f7ee78e tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] 10.222.0.20 "GET /compute/v2.1/servers/2044debc-6b41-413e-ac3d-89a4cca33a13" status: 200 len: 1263 microversion: 2.1 time: 0.151591 Jul 30 05:07:10.046033 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 539/1125] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:07:09 2022] GET /compute/v2.1/servers/2044debc-6b41-413e-ac3d-89a4cca33a13 => generated 1263 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 05:07:10.196237 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-646a8102-3155-4091-a66a-c8d0e4643b10 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:07:10.196784 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-646a8102-3155-4091-a66a-c8d0e4643b10 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] [instance: fb65e17c-681e-4949-a673-03130f14c360] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:07:10.203203 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-646a8102-3155-4091-a66a-c8d0e4643b10 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:07:10.203652 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-646a8102-3155-4091-a66a-c8d0e4643b10 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:07:10.204408 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-646a8102-3155-4091-a66a-c8d0e4643b10 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:07:10.204892 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-646a8102-3155-4091-a66a-c8d0e4643b10 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:07:10.337461 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-646a8102-3155-4091-a66a-c8d0e4643b10 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a805f5dec66484c8d950b6bc52e3e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f8c70dc5de488698a8ab775c618088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:07:10.345006 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-646a8102-3155-4091-a66a-c8d0e4643b10 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] 10.222.0.20 "GET /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360" status: 200 len: 1721 microversion: 2.1 time: 0.152689 Jul 30 05:07:10.346157 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 587/1126] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:07:10 2022] GET /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:07:11.068512 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-8e651e85-2e8d-4e70-89a1-3ff60f4dc4c8 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:07:11.069125 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-8e651e85-2e8d-4e70-89a1-3ff60f4dc4c8 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] [instance: 2044debc-6b41-413e-ac3d-89a4cca33a13] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:07:11.075821 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8e651e85-2e8d-4e70-89a1-3ff60f4dc4c8 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:07:11.076268 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8e651e85-2e8d-4e70-89a1-3ff60f4dc4c8 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:07:11.077027 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8e651e85-2e8d-4e70-89a1-3ff60f4dc4c8 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:07:11.077459 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8e651e85-2e8d-4e70-89a1-3ff60f4dc4c8 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:07:11.162709 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-6b33b32a-cf11-423f-ab5e-0d65a77920c1 req-0095f097-1335-4fa9-aafc-9e4ec009df9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2044debc-6b41-413e-ac3d-89a4cca33a13", "name": "network-vif-plugged", "status": "completed", "tag": "d47fd3ca-b5c7-44be-a749-9b228fae6174"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:07:11.173551 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-6b33b32a-cf11-423f-ab5e-0d65a77920c1 req-0095f097-1335-4fa9-aafc-9e4ec009df9e service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:07:11.174059 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-6b33b32a-cf11-423f-ab5e-0d65a77920c1 req-0095f097-1335-4fa9-aafc-9e4ec009df9e service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:07:11.186377 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-6b33b32a-cf11-423f-ab5e-0d65a77920c1 req-0095f097-1335-4fa9-aafc-9e4ec009df9e service nova] Creating event network-vif-plugged:d47fd3ca-b5c7-44be-a749-9b228fae6174 for instance 2044debc-6b41-413e-ac3d-89a4cca33a13 on hv-cinder-85127 Jul 30 05:07:11.192353 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-6b33b32a-cf11-423f-ab5e-0d65a77920c1 req-0095f097-1335-4fa9-aafc-9e4ec009df9e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033408 Jul 30 05:07:11.193142 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 588/1127] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Jul 30 05:07:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 05:07:11.215625 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-8e651e85-2e8d-4e70-89a1-3ff60f4dc4c8 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407ad282edd74fb1adf62fb63306779c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db365a6a9f6041a7a8749fd1a1e3d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:07:11.225675 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-8e651e85-2e8d-4e70-89a1-3ff60f4dc4c8 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] 10.222.0.20 "GET /compute/v2.1/servers/2044debc-6b41-413e-ac3d-89a4cca33a13" status: 200 len: 1263 microversion: 2.1 time: 0.162565 Jul 30 05:07:11.226341 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 540/1128] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:07:11 2022] GET /compute/v2.1/servers/2044debc-6b41-413e-ac3d-89a4cca33a13 => generated 1263 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:07:11.368002 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-95a60069-8f37-440c-8c9f-a5f17314d34d tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:07:11.368702 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-95a60069-8f37-440c-8c9f-a5f17314d34d tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] [instance: fb65e17c-681e-4949-a673-03130f14c360] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:07:11.375100 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-95a60069-8f37-440c-8c9f-a5f17314d34d tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:07:11.375665 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-95a60069-8f37-440c-8c9f-a5f17314d34d tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:07:11.377163 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-95a60069-8f37-440c-8c9f-a5f17314d34d tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:07:11.377608 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-95a60069-8f37-440c-8c9f-a5f17314d34d tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:07:11.512787 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-95a60069-8f37-440c-8c9f-a5f17314d34d tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a805f5dec66484c8d950b6bc52e3e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f8c70dc5de488698a8ab775c618088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:07:11.521128 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-95a60069-8f37-440c-8c9f-a5f17314d34d tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] 10.222.0.20 "GET /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360" status: 200 len: 1721 microversion: 2.1 time: 0.157812 Jul 30 05:07:11.521686 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 589/1129] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:07:11 2022] GET /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 05:07:12.246455 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-18b91708-b628-4cd1-801d-6e005976739e tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:07:12.247083 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-18b91708-b628-4cd1-801d-6e005976739e tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] [instance: 2044debc-6b41-413e-ac3d-89a4cca33a13] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:07:12.253598 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-18b91708-b628-4cd1-801d-6e005976739e tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:07:12.254038 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-18b91708-b628-4cd1-801d-6e005976739e tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:07:12.254985 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-18b91708-b628-4cd1-801d-6e005976739e tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:07:12.255422 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-18b91708-b628-4cd1-801d-6e005976739e tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:07:12.384887 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-18b91708-b628-4cd1-801d-6e005976739e tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407ad282edd74fb1adf62fb63306779c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db365a6a9f6041a7a8749fd1a1e3d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:07:12.392718 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-18b91708-b628-4cd1-801d-6e005976739e tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] 10.222.0.20 "GET /compute/v2.1/servers/2044debc-6b41-413e-ac3d-89a4cca33a13" status: 200 len: 1263 microversion: 2.1 time: 0.149616 Jul 30 05:07:12.393320 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 541/1130] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:07:12 2022] GET /compute/v2.1/servers/2044debc-6b41-413e-ac3d-89a4cca33a13 => generated 1263 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:07:12.542364 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-4dd43895-cf79-4b5d-a108-7d86fb7e7508 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:07:12.543258 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-4dd43895-cf79-4b5d-a108-7d86fb7e7508 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] [instance: fb65e17c-681e-4949-a673-03130f14c360] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:07:12.550012 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4dd43895-cf79-4b5d-a108-7d86fb7e7508 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:07:12.550501 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4dd43895-cf79-4b5d-a108-7d86fb7e7508 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:07:12.551275 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4dd43895-cf79-4b5d-a108-7d86fb7e7508 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:07:12.551718 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-4dd43895-cf79-4b5d-a108-7d86fb7e7508 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:07:12.679622 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-4dd43895-cf79-4b5d-a108-7d86fb7e7508 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a805f5dec66484c8d950b6bc52e3e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f8c70dc5de488698a8ab775c618088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:07:12.687641 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-4dd43895-cf79-4b5d-a108-7d86fb7e7508 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] 10.222.0.20 "GET /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360" status: 200 len: 1721 microversion: 2.1 time: 0.149170 Jul 30 05:07:12.688210 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 590/1131] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:07:12 2022] GET /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360 => generated 1721 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:07:13.413592 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-8a4ca433-d898-4222-91a2-9855e9122a3b tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:07:13.414142 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-8a4ca433-d898-4222-91a2-9855e9122a3b tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] [instance: 2044debc-6b41-413e-ac3d-89a4cca33a13] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:07:13.421008 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8a4ca433-d898-4222-91a2-9855e9122a3b tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:07:13.421479 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8a4ca433-d898-4222-91a2-9855e9122a3b tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:07:13.422247 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8a4ca433-d898-4222-91a2-9855e9122a3b tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:07:13.422713 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8a4ca433-d898-4222-91a2-9855e9122a3b tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:07:13.427018 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:07:13.557050 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-8a4ca433-d898-4222-91a2-9855e9122a3b tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407ad282edd74fb1adf62fb63306779c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db365a6a9f6041a7a8749fd1a1e3d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:07:13.565026 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-8a4ca433-d898-4222-91a2-9855e9122a3b tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] 10.222.0.20 "GET /compute/v2.1/servers/2044debc-6b41-413e-ac3d-89a4cca33a13" status: 200 len: 1451 microversion: 2.1 time: 0.155600 Jul 30 05:07:13.565782 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 542/1132] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:07:13 2022] GET /compute/v2.1/servers/2044debc-6b41-413e-ac3d-89a4cca33a13 => generated 1451 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:07:13.585595 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-6f5a0bbf-9fd6-40d7-b9f6-aea3ec84e13f tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:07:13.586218 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-6f5a0bbf-9fd6-40d7-b9f6-aea3ec84e13f tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] [instance: 2044debc-6b41-413e-ac3d-89a4cca33a13] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:07:13.592779 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6f5a0bbf-9fd6-40d7-b9f6-aea3ec84e13f tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:07:13.593234 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6f5a0bbf-9fd6-40d7-b9f6-aea3ec84e13f tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:07:13.594001 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6f5a0bbf-9fd6-40d7-b9f6-aea3ec84e13f tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:07:13.594456 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6f5a0bbf-9fd6-40d7-b9f6-aea3ec84e13f tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:07:13.711723 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-6e568322-5376-49d2-be35-28ae4ab122b9 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:07:13.712339 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-6e568322-5376-49d2-be35-28ae4ab122b9 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] [instance: fb65e17c-681e-4949-a673-03130f14c360] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:07:13.718318 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6e568322-5376-49d2-be35-28ae4ab122b9 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:07:13.718801 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6e568322-5376-49d2-be35-28ae4ab122b9 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:07:13.719564 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6e568322-5376-49d2-be35-28ae4ab122b9 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:07:13.720005 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6e568322-5376-49d2-be35-28ae4ab122b9 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:07:13.727237 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-6f5a0bbf-9fd6-40d7-b9f6-aea3ec84e13f tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407ad282edd74fb1adf62fb63306779c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db365a6a9f6041a7a8749fd1a1e3d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:07:13.734751 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-6f5a0bbf-9fd6-40d7-b9f6-aea3ec84e13f tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] 10.222.0.20 "GET /compute/v2.1/servers/2044debc-6b41-413e-ac3d-89a4cca33a13" status: 200 len: 1451 microversion: 2.1 time: 0.152949 Jul 30 05:07:13.735324 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 591/1133] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:07:13 2022] GET /compute/v2.1/servers/2044debc-6b41-413e-ac3d-89a4cca33a13 => generated 1451 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:07:13.851454 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-6e568322-5376-49d2-be35-28ae4ab122b9 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a805f5dec66484c8d950b6bc52e3e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f8c70dc5de488698a8ab775c618088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:07:13.859973 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-6e568322-5376-49d2-be35-28ae4ab122b9 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] 10.222.0.20 "GET /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360" status: 200 len: 1721 microversion: 2.1 time: 0.152092 Jul 30 05:07:13.860724 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 543/1134] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:07:13 2022] GET /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 05:07:14.882199 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-d2030d12-98cb-46c4-ba9f-e4d451850550 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:07:14.882791 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-d2030d12-98cb-46c4-ba9f-e4d451850550 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] [instance: fb65e17c-681e-4949-a673-03130f14c360] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:07:14.889197 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d2030d12-98cb-46c4-ba9f-e4d451850550 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:07:14.889652 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d2030d12-98cb-46c4-ba9f-e4d451850550 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:07:14.890423 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d2030d12-98cb-46c4-ba9f-e4d451850550 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:07:14.891079 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d2030d12-98cb-46c4-ba9f-e4d451850550 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:07:15.397396 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-d2030d12-98cb-46c4-ba9f-e4d451850550 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a805f5dec66484c8d950b6bc52e3e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f8c70dc5de488698a8ab775c618088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:07:15.401650 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=100 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:07:15.407404 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-d2030d12-98cb-46c4-ba9f-e4d451850550 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] 10.222.0.20 "GET /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360" status: 200 len: 1721 microversion: 2.1 time: 0.529157 Jul 30 05:07:15.407992 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 592/1135] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:07:14 2022] GET /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360 => generated 1721 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:07:15.826127 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-63ee4dfa-ce53-4701-a7af-558ce81163de req-64f62b08-1cbf-4af3-92b5-34028b2d68e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2044debc-6b41-413e-ac3d-89a4cca33a13", "tag": "d47fd3ca-b5c7-44be-a749-9b228fae6174"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:07:15.837321 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-63ee4dfa-ce53-4701-a7af-558ce81163de req-64f62b08-1cbf-4af3-92b5-34028b2d68e0 service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:07:15.837771 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-63ee4dfa-ce53-4701-a7af-558ce81163de req-64f62b08-1cbf-4af3-92b5-34028b2d68e0 service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:07:15.849374 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-63ee4dfa-ce53-4701-a7af-558ce81163de req-64f62b08-1cbf-4af3-92b5-34028b2d68e0 service nova] Creating event network-changed:d47fd3ca-b5c7-44be-a749-9b228fae6174 for instance 2044debc-6b41-413e-ac3d-89a4cca33a13 on hv-cinder-85127 Jul 30 05:07:15.854352 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-63ee4dfa-ce53-4701-a7af-558ce81163de req-64f62b08-1cbf-4af3-92b5-34028b2d68e0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031939 Jul 30 05:07:15.854973 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 544/1136] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Jul 30 05:07:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 05:07:16.430508 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-55eb0789-f205-402c-96bf-9d51eff1b597 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:07:16.431130 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-55eb0789-f205-402c-96bf-9d51eff1b597 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] [instance: fb65e17c-681e-4949-a673-03130f14c360] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:07:16.445270 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-55eb0789-f205-402c-96bf-9d51eff1b597 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:07:16.445988 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-55eb0789-f205-402c-96bf-9d51eff1b597 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:07:16.446862 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-55eb0789-f205-402c-96bf-9d51eff1b597 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:07:16.447304 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-55eb0789-f205-402c-96bf-9d51eff1b597 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:07:16.583896 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-55eb0789-f205-402c-96bf-9d51eff1b597 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a805f5dec66484c8d950b6bc52e3e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f8c70dc5de488698a8ab775c618088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:07:16.592276 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-55eb0789-f205-402c-96bf-9d51eff1b597 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] 10.222.0.20 "GET /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360" status: 200 len: 1698 microversion: 2.1 time: 0.166322 Jul 30 05:07:16.592855 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 593/1137] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:07:16 2022] GET /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360 => generated 1698 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:07:16.614506 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-a2d275a4-8d73-4357-b7c2-9af1b0056e4c tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:07:16.621046 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a2d275a4-8d73-4357-b7c2-9af1b0056e4c tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:07:16.621511 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a2d275a4-8d73-4357-b7c2-9af1b0056e4c tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:07:16.645237 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-a2d275a4-8d73-4357-b7c2-9af1b0056e4c tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] [instance: fb65e17c-681e-4949-a673-03130f14c360] Going to try to start instance {{(pid=117885) start /opt/stack/nova/nova/compute/api.py:2732}} Jul 30 05:07:16.690813 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-a2d275a4-8d73-4357-b7c2-9af1b0056e4c tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] 10.222.0.20 "POST /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360/action" status: 202 len: 0 microversion: 2.1 time: 0.081036 Jul 30 05:07:16.691316 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 545/1138] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Jul 30 05:07:16 2022] POST /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 30 05:07:16.699714 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-6a58003f-d1ae-4edd-a76d-c2e398f3fb7d tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:07:16.700329 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-6a58003f-d1ae-4edd-a76d-c2e398f3fb7d tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] [instance: fb65e17c-681e-4949-a673-03130f14c360] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:07:16.707699 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6a58003f-d1ae-4edd-a76d-c2e398f3fb7d tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:07:16.708177 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6a58003f-d1ae-4edd-a76d-c2e398f3fb7d tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:07:16.709286 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6a58003f-d1ae-4edd-a76d-c2e398f3fb7d tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:07:16.709727 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-6a58003f-d1ae-4edd-a76d-c2e398f3fb7d tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:07:16.853030 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-6a58003f-d1ae-4edd-a76d-c2e398f3fb7d tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a805f5dec66484c8d950b6bc52e3e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f8c70dc5de488698a8ab775c618088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:07:16.862182 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-6a58003f-d1ae-4edd-a76d-c2e398f3fb7d tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] 10.222.0.20 "GET /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360" status: 200 len: 1707 microversion: 2.1 time: 0.166059 Jul 30 05:07:16.862824 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 594/1139] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:07:16 2022] GET /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360 => generated 1707 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:07:17.885559 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-edc6e0c4-e05f-4884-89e4-5e8324481b7e tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:07:17.886270 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-edc6e0c4-e05f-4884-89e4-5e8324481b7e tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] [instance: fb65e17c-681e-4949-a673-03130f14c360] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:07:17.892552 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-edc6e0c4-e05f-4884-89e4-5e8324481b7e tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:07:17.893006 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-edc6e0c4-e05f-4884-89e4-5e8324481b7e tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:07:17.893781 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-edc6e0c4-e05f-4884-89e4-5e8324481b7e tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:07:17.894223 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-edc6e0c4-e05f-4884-89e4-5e8324481b7e tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:07:18.027573 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-edc6e0c4-e05f-4884-89e4-5e8324481b7e tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a805f5dec66484c8d950b6bc52e3e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f8c70dc5de488698a8ab775c618088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:07:18.036038 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-edc6e0c4-e05f-4884-89e4-5e8324481b7e tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] 10.222.0.20 "GET /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360" status: 200 len: 1707 microversion: 2.1 time: 0.155190 Jul 30 05:07:18.036605 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 546/1140] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:07:17 2022] GET /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360 => generated 1707 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:07:19.057475 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-e410afd8-f0ff-4490-b60c-a7d8bb178b48 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:07:19.058090 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-e410afd8-f0ff-4490-b60c-a7d8bb178b48 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] [instance: fb65e17c-681e-4949-a673-03130f14c360] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:07:19.060476 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:07:19.066621 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e410afd8-f0ff-4490-b60c-a7d8bb178b48 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:07:19.067076 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e410afd8-f0ff-4490-b60c-a7d8bb178b48 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:07:19.067842 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e410afd8-f0ff-4490-b60c-a7d8bb178b48 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:07:19.068281 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e410afd8-f0ff-4490-b60c-a7d8bb178b48 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:07:19.197142 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-e410afd8-f0ff-4490-b60c-a7d8bb178b48 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a805f5dec66484c8d950b6bc52e3e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f8c70dc5de488698a8ab775c618088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:07:19.205790 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-e410afd8-f0ff-4490-b60c-a7d8bb178b48 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] 10.222.0.20 "GET /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360" status: 200 len: 1711 microversion: 2.1 time: 0.152175 Jul 30 05:07:19.206353 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 595/1141] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:07:19 2022] GET /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360 => generated 1711 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:07:52.224654 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-645c34ad-327c-4777-bc58-1ad866010f40 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:07:52.225176 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-645c34ad-327c-4777-bc58-1ad866010f40 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] [instance: fb65e17c-681e-4949-a673-03130f14c360] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:07:52.227357 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_api:SELECT=42 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:07:52.228017 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:07:52.234543 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-645c34ad-327c-4777-bc58-1ad866010f40 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:07:52.235186 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-645c34ad-327c-4777-bc58-1ad866010f40 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:07:52.235976 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-645c34ad-327c-4777-bc58-1ad866010f40 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:07:52.236416 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-645c34ad-327c-4777-bc58-1ad866010f40 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:07:52.317453 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.objects.instance [None req-645c34ad-327c-4777-bc58-1ad866010f40 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lazy-loading 'services' on Instance uuid fb65e17c-681e-4949-a673-03130f14c360 {{(pid=117885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 05:07:52.388081 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-645c34ad-327c-4777-bc58-1ad866010f40 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] 10.222.0.20 "DELETE /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360/os-volume_attachments/c7ada58c-1786-4844-9df9-79a2289c7b34" status: 202 len: 0 microversion: 2.1 time: 0.167464 Jul 30 05:07:52.388694 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 547/1142] 10.222.0.20 () {58 vars in 1416 bytes} [Sat Jul 30 05:07:52 2022] DELETE /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360/os-volume_attachments/c7ada58c-1786-4844-9df9-79a2289c7b34 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 05:07:53.508450 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-a730ddef-fe29-4097-b97f-17ce53a1bad1 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:07:53.510747 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_api:SELECT=1 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:07:53.511402 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=18 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:07:53.517471 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a730ddef-fe29-4097-b97f-17ce53a1bad1 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:07:53.517957 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a730ddef-fe29-4097-b97f-17ce53a1bad1 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:07:53.576446 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-a730ddef-fe29-4097-b97f-17ce53a1bad1 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] [instance: fb65e17c-681e-4949-a673-03130f14c360] Going to try to stop instance {{(pid=117886) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Jul 30 05:07:53.619457 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-a730ddef-fe29-4097-b97f-17ce53a1bad1 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] 10.222.0.20 "POST /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360/action" status: 202 len: 0 microversion: 2.1 time: 0.114659 Jul 30 05:07:53.620239 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 596/1143] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Jul 30 05:07:53 2022] POST /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 05:07:53.629766 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-11dd5b74-00fe-405c-9f03-3045af6e75ae tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:07:53.630794 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-11dd5b74-00fe-405c-9f03-3045af6e75ae tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] [instance: fb65e17c-681e-4949-a673-03130f14c360] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:07:53.637602 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-11dd5b74-00fe-405c-9f03-3045af6e75ae tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:07:53.638104 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-11dd5b74-00fe-405c-9f03-3045af6e75ae tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:07:53.639024 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-11dd5b74-00fe-405c-9f03-3045af6e75ae tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:07:53.639548 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-11dd5b74-00fe-405c-9f03-3045af6e75ae tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:07:53.772105 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-11dd5b74-00fe-405c-9f03-3045af6e75ae tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a805f5dec66484c8d950b6bc52e3e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f8c70dc5de488698a8ab775c618088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:07:53.779600 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-11dd5b74-00fe-405c-9f03-3045af6e75ae tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] 10.222.0.20 "GET /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360" status: 200 len: 1675 microversion: 2.1 time: 0.154906 Jul 30 05:07:53.780166 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 548/1144] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:07:53 2022] GET /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360 => generated 1675 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:07:54.803238 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-05973ee7-4265-4485-bf12-09e31adf82c5 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:07:54.803955 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-05973ee7-4265-4485-bf12-09e31adf82c5 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] [instance: fb65e17c-681e-4949-a673-03130f14c360] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:07:54.810591 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-05973ee7-4265-4485-bf12-09e31adf82c5 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:07:54.811038 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-05973ee7-4265-4485-bf12-09e31adf82c5 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:07:54.811794 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-05973ee7-4265-4485-bf12-09e31adf82c5 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:07:54.812226 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-05973ee7-4265-4485-bf12-09e31adf82c5 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:07:54.945300 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-05973ee7-4265-4485-bf12-09e31adf82c5 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a805f5dec66484c8d950b6bc52e3e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f8c70dc5de488698a8ab775c618088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:07:54.952683 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-05973ee7-4265-4485-bf12-09e31adf82c5 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] 10.222.0.20 "GET /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360" status: 200 len: 1675 microversion: 2.1 time: 0.154274 Jul 30 05:07:54.953244 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 597/1145] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:07:54 2022] GET /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360 => generated 1675 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:07:55.973741 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-27480b7e-8f21-4fd2-8140-f149f25a3b31 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:07:55.974278 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-27480b7e-8f21-4fd2-8140-f149f25a3b31 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] [instance: fb65e17c-681e-4949-a673-03130f14c360] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:07:55.980287 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-27480b7e-8f21-4fd2-8140-f149f25a3b31 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:07:55.980740 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-27480b7e-8f21-4fd2-8140-f149f25a3b31 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:07:55.981537 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-27480b7e-8f21-4fd2-8140-f149f25a3b31 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:07:55.981977 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-27480b7e-8f21-4fd2-8140-f149f25a3b31 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:07:56.113917 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-27480b7e-8f21-4fd2-8140-f149f25a3b31 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a805f5dec66484c8d950b6bc52e3e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f8c70dc5de488698a8ab775c618088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:07:56.121332 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-27480b7e-8f21-4fd2-8140-f149f25a3b31 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] 10.222.0.20 "GET /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360" status: 200 len: 1675 microversion: 2.1 time: 0.152031 Jul 30 05:07:56.121898 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 549/1146] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:07:55 2022] GET /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360 => generated 1675 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:07:57.143916 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-0ea3ddf7-3bd4-47a6-97f9-6d1edd1e3b70 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:07:57.144528 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-0ea3ddf7-3bd4-47a6-97f9-6d1edd1e3b70 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] [instance: fb65e17c-681e-4949-a673-03130f14c360] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:07:57.150903 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0ea3ddf7-3bd4-47a6-97f9-6d1edd1e3b70 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:07:57.151349 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0ea3ddf7-3bd4-47a6-97f9-6d1edd1e3b70 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:07:57.152108 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0ea3ddf7-3bd4-47a6-97f9-6d1edd1e3b70 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:07:57.152540 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-0ea3ddf7-3bd4-47a6-97f9-6d1edd1e3b70 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:07:57.280911 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-0ea3ddf7-3bd4-47a6-97f9-6d1edd1e3b70 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a805f5dec66484c8d950b6bc52e3e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f8c70dc5de488698a8ab775c618088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:07:57.289119 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-0ea3ddf7-3bd4-47a6-97f9-6d1edd1e3b70 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] 10.222.0.20 "GET /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360" status: 200 len: 1675 microversion: 2.1 time: 0.149591 Jul 30 05:07:57.289691 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 598/1147] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:07:57 2022] GET /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360 => generated 1675 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:07:58.311063 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-bfa53eb9-eb22-4fd6-9240-1bf94344456e tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:07:58.311624 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-bfa53eb9-eb22-4fd6-9240-1bf94344456e tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] [instance: fb65e17c-681e-4949-a673-03130f14c360] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:07:58.318658 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-bfa53eb9-eb22-4fd6-9240-1bf94344456e tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:07:58.319110 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-bfa53eb9-eb22-4fd6-9240-1bf94344456e tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:07:58.319873 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-bfa53eb9-eb22-4fd6-9240-1bf94344456e tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:07:58.320313 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-bfa53eb9-eb22-4fd6-9240-1bf94344456e tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:07:58.452630 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-bfa53eb9-eb22-4fd6-9240-1bf94344456e tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a805f5dec66484c8d950b6bc52e3e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f8c70dc5de488698a8ab775c618088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:07:58.461006 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-bfa53eb9-eb22-4fd6-9240-1bf94344456e tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] 10.222.0.20 "GET /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360" status: 200 len: 1675 microversion: 2.1 time: 0.153887 Jul 30 05:07:58.461580 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 550/1148] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:07:58 2022] GET /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360 => generated 1675 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:07:59.482330 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-9dd51b71-d847-4feb-bd39-778b2ff2c16a tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:07:59.482972 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-9dd51b71-d847-4feb-bd39-778b2ff2c16a tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] [instance: fb65e17c-681e-4949-a673-03130f14c360] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:07:59.490478 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9dd51b71-d847-4feb-bd39-778b2ff2c16a tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:07:59.490921 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9dd51b71-d847-4feb-bd39-778b2ff2c16a tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:07:59.491683 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9dd51b71-d847-4feb-bd39-778b2ff2c16a tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:07:59.492123 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-9dd51b71-d847-4feb-bd39-778b2ff2c16a tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:07:59.622303 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-9dd51b71-d847-4feb-bd39-778b2ff2c16a tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a805f5dec66484c8d950b6bc52e3e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f8c70dc5de488698a8ab775c618088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:07:59.630694 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-9dd51b71-d847-4feb-bd39-778b2ff2c16a tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] 10.222.0.20 "GET /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360" status: 200 len: 1675 microversion: 2.1 time: 0.152204 Jul 30 05:07:59.631263 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 599/1149] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:07:59 2022] GET /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360 => generated 1675 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:08:00.652225 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-9f95a08c-b757-4f8f-8253-7bf51205a80f tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:08:00.652852 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-9f95a08c-b757-4f8f-8253-7bf51205a80f tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] [instance: fb65e17c-681e-4949-a673-03130f14c360] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:08:00.660146 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9f95a08c-b757-4f8f-8253-7bf51205a80f tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:08:00.660610 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9f95a08c-b757-4f8f-8253-7bf51205a80f tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:08:00.661383 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9f95a08c-b757-4f8f-8253-7bf51205a80f tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:08:00.661830 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9f95a08c-b757-4f8f-8253-7bf51205a80f tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:08:00.791008 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-9f95a08c-b757-4f8f-8253-7bf51205a80f tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a805f5dec66484c8d950b6bc52e3e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f8c70dc5de488698a8ab775c618088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:08:00.799278 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-9f95a08c-b757-4f8f-8253-7bf51205a80f tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] 10.222.0.20 "GET /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360" status: 200 len: 1675 microversion: 2.1 time: 0.150429 Jul 30 05:08:00.799849 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 551/1150] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:08:00 2022] GET /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360 => generated 1675 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:08:01.820661 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-c58060cd-88f6-4904-bb1b-36dfc2eca202 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:08:01.821280 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-c58060cd-88f6-4904-bb1b-36dfc2eca202 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] [instance: fb65e17c-681e-4949-a673-03130f14c360] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:08:01.827833 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c58060cd-88f6-4904-bb1b-36dfc2eca202 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:08:01.828286 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c58060cd-88f6-4904-bb1b-36dfc2eca202 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:08:01.829049 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c58060cd-88f6-4904-bb1b-36dfc2eca202 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:08:01.829485 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-c58060cd-88f6-4904-bb1b-36dfc2eca202 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:08:01.962004 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-c58060cd-88f6-4904-bb1b-36dfc2eca202 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a805f5dec66484c8d950b6bc52e3e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f8c70dc5de488698a8ab775c618088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:08:01.969465 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-c58060cd-88f6-4904-bb1b-36dfc2eca202 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] 10.222.0.20 "GET /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360" status: 200 len: 1675 microversion: 2.1 time: 0.152675 Jul 30 05:08:01.970030 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 600/1151] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:08:01 2022] GET /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360 => generated 1675 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:08:02.991622 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-2e181abc-3303-4bee-9d64-d2f681accd40 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:08:02.992243 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-2e181abc-3303-4bee-9d64-d2f681accd40 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] [instance: fb65e17c-681e-4949-a673-03130f14c360] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:08:02.998824 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2e181abc-3303-4bee-9d64-d2f681accd40 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:08:02.999274 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2e181abc-3303-4bee-9d64-d2f681accd40 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:08:03.000039 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2e181abc-3303-4bee-9d64-d2f681accd40 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:08:03.000480 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2e181abc-3303-4bee-9d64-d2f681accd40 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:08:03.129577 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-2e181abc-3303-4bee-9d64-d2f681accd40 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a805f5dec66484c8d950b6bc52e3e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f8c70dc5de488698a8ab775c618088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:08:03.136988 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-2e181abc-3303-4bee-9d64-d2f681accd40 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] 10.222.0.20 "GET /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360" status: 200 len: 1675 microversion: 2.1 time: 0.149249 Jul 30 05:08:03.137550 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 552/1152] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:08:02 2022] GET /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360 => generated 1675 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:08:04.159446 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-a487d157-74e4-413a-a0df-694af8b0aa1f tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:08:04.159989 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-a487d157-74e4-413a-a0df-694af8b0aa1f tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] [instance: fb65e17c-681e-4949-a673-03130f14c360] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:08:04.166019 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a487d157-74e4-413a-a0df-694af8b0aa1f tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:08:04.166488 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a487d157-74e4-413a-a0df-694af8b0aa1f tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:08:04.167506 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a487d157-74e4-413a-a0df-694af8b0aa1f tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:08:04.167936 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a487d157-74e4-413a-a0df-694af8b0aa1f tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:08:04.294973 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-a487d157-74e4-413a-a0df-694af8b0aa1f tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a805f5dec66484c8d950b6bc52e3e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f8c70dc5de488698a8ab775c618088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:08:04.303366 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-a487d157-74e4-413a-a0df-694af8b0aa1f tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] 10.222.0.20 "GET /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360" status: 200 len: 1652 microversion: 2.1 time: 0.148005 Jul 30 05:08:04.303980 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 601/1153] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:08:04 2022] GET /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360 => generated 1652 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:08:04.324829 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-abcceb42-6e68-42d4-b449-78a37b041ac3 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:08:04.331670 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-abcceb42-6e68-42d4-b449-78a37b041ac3 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:08:04.332116 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-abcceb42-6e68-42d4-b449-78a37b041ac3 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:08:04.354995 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-abcceb42-6e68-42d4-b449-78a37b041ac3 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] [instance: fb65e17c-681e-4949-a673-03130f14c360] Going to try to start instance {{(pid=117885) start /opt/stack/nova/nova/compute/api.py:2732}} Jul 30 05:08:04.397226 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-abcceb42-6e68-42d4-b449-78a37b041ac3 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] 10.222.0.20 "POST /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360/action" status: 202 len: 0 microversion: 2.1 time: 0.076162 Jul 30 05:08:04.397833 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 553/1154] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Jul 30 05:08:04 2022] POST /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 05:08:04.405978 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-dc9f5e9c-f7ee-47fc-9807-acd7f2e4190f tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:08:04.406623 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-dc9f5e9c-f7ee-47fc-9807-acd7f2e4190f tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] [instance: fb65e17c-681e-4949-a673-03130f14c360] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:08:04.412801 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-dc9f5e9c-f7ee-47fc-9807-acd7f2e4190f tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:08:04.413017 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-dc9f5e9c-f7ee-47fc-9807-acd7f2e4190f tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:08:04.413787 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-dc9f5e9c-f7ee-47fc-9807-acd7f2e4190f tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:08:04.414226 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-dc9f5e9c-f7ee-47fc-9807-acd7f2e4190f tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:08:04.553222 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-dc9f5e9c-f7ee-47fc-9807-acd7f2e4190f tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a805f5dec66484c8d950b6bc52e3e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f8c70dc5de488698a8ab775c618088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:08:04.560873 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-dc9f5e9c-f7ee-47fc-9807-acd7f2e4190f tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] 10.222.0.20 "GET /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360" status: 200 len: 1661 microversion: 2.1 time: 0.158760 Jul 30 05:08:04.561504 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 602/1155] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:08:04 2022] GET /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360 => generated 1661 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:08:05.584549 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-3236e2bd-6c55-4a13-a4e9-8ca208db01ef tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:08:05.585281 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-3236e2bd-6c55-4a13-a4e9-8ca208db01ef tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] [instance: fb65e17c-681e-4949-a673-03130f14c360] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:08:05.591886 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3236e2bd-6c55-4a13-a4e9-8ca208db01ef tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:08:05.592331 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3236e2bd-6c55-4a13-a4e9-8ca208db01ef tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:08:05.593084 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3236e2bd-6c55-4a13-a4e9-8ca208db01ef tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:08:05.593518 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-3236e2bd-6c55-4a13-a4e9-8ca208db01ef tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:08:05.733645 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-3236e2bd-6c55-4a13-a4e9-8ca208db01ef tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a805f5dec66484c8d950b6bc52e3e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f8c70dc5de488698a8ab775c618088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:08:05.742221 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-3236e2bd-6c55-4a13-a4e9-8ca208db01ef tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] 10.222.0.20 "GET /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360" status: 200 len: 1661 microversion: 2.1 time: 0.161900 Jul 30 05:08:05.742818 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 554/1156] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:08:05 2022] GET /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360 => generated 1661 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:08:06.763465 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-58931045-7d6d-4076-8e46-88e0346c8ec8 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:08:06.764074 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-58931045-7d6d-4076-8e46-88e0346c8ec8 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] [instance: fb65e17c-681e-4949-a673-03130f14c360] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:08:06.770972 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-58931045-7d6d-4076-8e46-88e0346c8ec8 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:08:06.771417 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-58931045-7d6d-4076-8e46-88e0346c8ec8 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:08:06.772171 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-58931045-7d6d-4076-8e46-88e0346c8ec8 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:08:06.772602 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-58931045-7d6d-4076-8e46-88e0346c8ec8 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:08:06.902009 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-58931045-7d6d-4076-8e46-88e0346c8ec8 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a805f5dec66484c8d950b6bc52e3e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f8c70dc5de488698a8ab775c618088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:08:06.910218 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-58931045-7d6d-4076-8e46-88e0346c8ec8 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] 10.222.0.20 "GET /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360" status: 200 len: 1665 microversion: 2.1 time: 0.150598 Jul 30 05:08:06.910768 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 603/1157] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:08:06 2022] GET /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360 => generated 1665 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:08:21.709165 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 30 05:08:21.709860 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Sat Jul 30 05:08:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 30 05:08:22.018056 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 30 05:08:22.018591 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Sat Jul 30 05:08:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 30 05:08:27.258094 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 30 05:08:27.258707 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Sat Jul 30 05:08:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 30 05:08:38.850296 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-7e899886-866e-4a98-9727-9f5034eaceaf tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:08:38.853405 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-7e899886-866e-4a98-9727-9f5034eaceaf tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] [instance: fb65e17c-681e-4949-a673-03130f14c360] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:08:38.856232 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_api:SELECT=16 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:08:38.856880 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:08:38.863717 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7e899886-866e-4a98-9727-9f5034eaceaf tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:08:38.864160 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7e899886-866e-4a98-9727-9f5034eaceaf tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:08:38.864963 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7e899886-866e-4a98-9727-9f5034eaceaf tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:08:38.865424 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7e899886-866e-4a98-9727-9f5034eaceaf tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:08:38.895284 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-7e899886-866e-4a98-9727-9f5034eaceaf tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] 10.222.0.20 "GET /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050765 Jul 30 05:08:38.895619 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 555/1158] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Jul 30 05:08:38 2022] GET /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 30 05:08:38.956438 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-16a09810-b038-4577-a334-e3a7c570655c tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:08:38.956974 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-16a09810-b038-4577-a334-e3a7c570655c tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] [instance: fb65e17c-681e-4949-a673-03130f14c360] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:08:38.959031 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_api:SELECT=16 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:08:38.959710 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:08:38.965244 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-16a09810-b038-4577-a334-e3a7c570655c tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:08:38.965697 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-16a09810-b038-4577-a334-e3a7c570655c tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:08:38.966472 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-16a09810-b038-4577-a334-e3a7c570655c tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:08:38.966914 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-16a09810-b038-4577-a334-e3a7c570655c tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:08:38.993221 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-16a09810-b038-4577-a334-e3a7c570655c tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] [instance: fb65e17c-681e-4949-a673-03130f14c360] Going to try to terminate instance {{(pid=117886) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 05:08:39.067178 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-16a09810-b038-4577-a334-e3a7c570655c tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] 10.222.0.20 "DELETE /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360" status: 204 len: 0 microversion: 2.1 time: 0.114832 Jul 30 05:08:39.067862 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 604/1159] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Jul 30 05:08:38 2022] DELETE /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 05:08:39.076243 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-2f7f117e-13ed-43c8-aada-628af62d815e tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:08:39.076860 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-2f7f117e-13ed-43c8-aada-628af62d815e tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] [instance: fb65e17c-681e-4949-a673-03130f14c360] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:08:39.082865 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2f7f117e-13ed-43c8-aada-628af62d815e tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:08:39.083321 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2f7f117e-13ed-43c8-aada-628af62d815e tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:08:39.084096 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2f7f117e-13ed-43c8-aada-628af62d815e tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:08:39.084539 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2f7f117e-13ed-43c8-aada-628af62d815e tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:08:39.348488 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-2f7f117e-13ed-43c8-aada-628af62d815e tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a805f5dec66484c8d950b6bc52e3e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f8c70dc5de488698a8ab775c618088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:08:39.356422 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-2f7f117e-13ed-43c8-aada-628af62d815e tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] 10.222.0.20 "GET /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360" status: 200 len: 1671 microversion: 2.1 time: 0.284104 Jul 30 05:08:39.357014 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 556/1160] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:08:39 2022] GET /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360 => generated 1671 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:08:40.379799 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-523c7f08-b0fd-4f9a-9690-3e1160b90cda tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:08:40.380517 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-523c7f08-b0fd-4f9a-9690-3e1160b90cda tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] [instance: fb65e17c-681e-4949-a673-03130f14c360] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:08:40.386923 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-523c7f08-b0fd-4f9a-9690-3e1160b90cda tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:08:40.387369 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-523c7f08-b0fd-4f9a-9690-3e1160b90cda tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:08:40.388127 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-523c7f08-b0fd-4f9a-9690-3e1160b90cda tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:08:40.388559 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-523c7f08-b0fd-4f9a-9690-3e1160b90cda tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:08:40.566799 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-523c7f08-b0fd-4f9a-9690-3e1160b90cda tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a805f5dec66484c8d950b6bc52e3e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f8c70dc5de488698a8ab775c618088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:08:40.574198 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-523c7f08-b0fd-4f9a-9690-3e1160b90cda tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] 10.222.0.20 "GET /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360" status: 200 len: 1671 microversion: 2.1 time: 0.199137 Jul 30 05:08:40.574789 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 605/1161] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:08:40 2022] GET /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360 => generated 1671 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:08:41.597483 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-f9c5989e-c548-429c-afdb-6609f9ebd6fc tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:08:41.598161 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-f9c5989e-c548-429c-afdb-6609f9ebd6fc tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] [instance: fb65e17c-681e-4949-a673-03130f14c360] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:08:41.604608 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f9c5989e-c548-429c-afdb-6609f9ebd6fc tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:08:41.605073 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f9c5989e-c548-429c-afdb-6609f9ebd6fc tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:08:41.605850 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f9c5989e-c548-429c-afdb-6609f9ebd6fc tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:08:41.606297 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-f9c5989e-c548-429c-afdb-6609f9ebd6fc tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:08:41.676938 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-f9c5989e-c548-429c-afdb-6609f9ebd6fc tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a805f5dec66484c8d950b6bc52e3e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f8c70dc5de488698a8ab775c618088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:08:41.685820 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-f9c5989e-c548-429c-afdb-6609f9ebd6fc tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] 10.222.0.20 "GET /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360" status: 200 len: 1603 microversion: 2.1 time: 0.093135 Jul 30 05:08:41.686402 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 557/1162] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:08:41 2022] GET /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360 => generated 1603 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:08:41.733762 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-4eac118a-62c2-4513-a500-a0b635b02cf7 req-3bb853c5-bd99-4bd8-9d68-806d5623079f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb65e17c-681e-4949-a673-03130f14c360", "name": "network-vif-deleted", "tag": "267d1818-566d-49c4-b27c-b194d59ebd4c"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:08:41.745004 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-4eac118a-62c2-4513-a500-a0b635b02cf7 req-3bb853c5-bd99-4bd8-9d68-806d5623079f service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:08:41.745478 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-4eac118a-62c2-4513-a500-a0b635b02cf7 req-3bb853c5-bd99-4bd8-9d68-806d5623079f service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:08:41.758196 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-4eac118a-62c2-4513-a500-a0b635b02cf7 req-3bb853c5-bd99-4bd8-9d68-806d5623079f service nova] Creating event network-vif-deleted:267d1818-566d-49c4-b27c-b194d59ebd4c for instance fb65e17c-681e-4949-a673-03130f14c360 on hv-cinder-85127 Jul 30 05:08:41.763131 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-4eac118a-62c2-4513-a500-a0b635b02cf7 req-3bb853c5-bd99-4bd8-9d68-806d5623079f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033005 Jul 30 05:08:41.764063 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 606/1163] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Jul 30 05:08:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 05:08:42.709334 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-1ca34fe6-54fb-4605-9be8-5a78bef8e8ba tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:08:42.709963 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-1ca34fe6-54fb-4605-9be8-5a78bef8e8ba tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] [instance: fb65e17c-681e-4949-a673-03130f14c360] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:08:42.716684 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1ca34fe6-54fb-4605-9be8-5a78bef8e8ba tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:08:42.717142 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1ca34fe6-54fb-4605-9be8-5a78bef8e8ba tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:08:42.717917 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1ca34fe6-54fb-4605-9be8-5a78bef8e8ba tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:08:42.718369 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-1ca34fe6-54fb-4605-9be8-5a78bef8e8ba tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:08:42.731829 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.wsgi [None req-1ca34fe6-54fb-4605-9be8-5a78bef8e8ba tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] HTTP exception thrown: Instance fb65e17c-681e-4949-a673-03130f14c360 could not be found. Jul 30 05:08:42.733407 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-1ca34fe6-54fb-4605-9be8-5a78bef8e8ba tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Request method failure captured: Jul 30 05:08:42.733407 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: request: GET /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360 HTTP/1.1 Jul 30 05:08:42.733407 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Accept: application/json Jul 30 05:08:42.733407 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Accept-Encoding: identity Jul 30 05:08:42.733407 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Connection: close Jul 30 05:08:42.733407 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Content-Length: 0 Jul 30 05:08:42.733407 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Content-Type: application/json Jul 30 05:08:42.733407 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Host: 10.222.0.20 Jul 30 05:08:42.733407 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Openstack-System-Scope: None Jul 30 05:08:42.733407 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: User-Agent: python-urllib3/1.26.10 Jul 30 05:08:42.733407 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Auth-Token: gAAAAABi5Lwx6u3dW8NgrhXRDeFXnnP4lKZIRtv95bi5xMIG9sQWzxvNRse6IwUXHzfxnT7jfXw1pF1w6rwEHJ09LzDtMWM5u0sWuNEZ6hZdfnFHX8MrtI_AUV39i3jn62Xa0Oa4hMKssKbQMxnqU81KKd6CEuwP8myCBr3mKHN0Nm_CGgcZN90 Jul 30 05:08:42.733407 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Domain-Id: None Jul 30 05:08:42.733407 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Domain-Name: None Jul 30 05:08:42.733407 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Identity-Status: Confirmed Jul 30 05:08:42.733407 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Is-Admin-Project: True Jul 30 05:08:42.733407 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Domain-Id: default Jul 30 05:08:42.733407 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Domain-Name: Default Jul 30 05:08:42.733407 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Id: d9f8c70dc5de488698a8ab775c618088 Jul 30 05:08:42.733407 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Name: tempest-AttachVolumeTestJSON-1448876773 Jul 30 05:08:42.733407 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Role: member,reader Jul 30 05:08:42.733407 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Roles: member,reader Jul 30 05:08:42.736287 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d9f8c70dc5de488698a8ab775c618088"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d9f8c70dc5de488698a8ab775c618088"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d9f8c70dc5de488698a8ab775c618088"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d9f8c70dc5de488698a8ab775c618088"}]}] Jul 30 05:08:42.736287 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Tenant: tempest-AttachVolumeTestJSON-1448876773 Jul 30 05:08:42.736287 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Tenant-Id: d9f8c70dc5de488698a8ab775c618088 Jul 30 05:08:42.736287 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1448876773 Jul 30 05:08:42.736287 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User: tempest-AttachVolumeTestJSON-1448876773-project Jul 30 05:08:42.736287 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Domain-Id: default Jul 30 05:08:42.736287 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Domain-Name: Default Jul 30 05:08:42.736287 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Id: 3a805f5dec66484c8d950b6bc52e3e03 Jul 30 05:08:42.736287 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Name: tempest-AttachVolumeTestJSON-1448876773-project Jul 30 05:08:42.736287 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: method: > Jul 30 05:08:42.736287 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: exception: Instance fb65e17c-681e-4949-a673-03130f14c360 could not be found. Jul 30 05:08:42.736287 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: action_args: {'id': 'fb65e17c-681e-4949-a673-03130f14c360'} Jul 30 05:08:42.737364 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 05:08:42.737364 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:08:42.737364 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 05:08:42.737364 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 05:08:42.737364 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 05:08:42.737364 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 05:08:42.737364 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 05:08:42.737364 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 05:08:42.737364 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 05:08:42.737364 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 05:08:42.737364 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb65e17c-681e-4949-a673-03130f14c360 could not be found. Jul 30 05:08:42.737364 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:08:42.737364 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 05:08:42.737364 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:08:42.737364 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:08:42.737364 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 05:08:42.737364 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 05:08:42.737364 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 05:08:42.737364 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 05:08:42.737364 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 05:08:42.738976 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 05:08:42.738976 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 05:08:42.738976 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 05:08:42.738976 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 05:08:42.738976 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 05:08:42.738976 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 05:08:42.738976 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 05:08:42.738976 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb65e17c-681e-4949-a673-03130f14c360 could not be found. Jul 30 05:08:42.738976 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:08:42.738976 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 05:08:42.738976 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:08:42.738976 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:08:42.738976 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 05:08:42.738976 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 05:08:42.738976 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 05:08:42.738976 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 05:08:42.738976 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb65e17c-681e-4949-a673-03130f14c360 could not be found. Jul 30 05:08:42.738976 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:08:42.740463 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-1ca34fe6-54fb-4605-9be8-5a78bef8e8ba tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Returning 404 to user: Instance fb65e17c-681e-4949-a673-03130f14c360 could not be found. {{(pid=117885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 05:08:42.740463 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-1ca34fe6-54fb-4605-9be8-5a78bef8e8ba tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] 10.222.0.20 "GET /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360" status: 404 len: 111 microversion: 2.1 time: 0.029456 Jul 30 05:08:42.740463 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 558/1164] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:08:42 2022] GET /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 05:08:42.745212 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-cb77ad8d-4cbc-4f44-bcee-f8a4e09c7f4c tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Calling method '.version_select at 0x7f2db401bf70>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:08:42.767306 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-cb77ad8d-4cbc-4f44-bcee-f8a4e09c7f4c tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-876609958" status: 202 len: 0 microversion: 2.1 time: 0.026569 Jul 30 05:08:42.767889 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 607/1165] 10.222.0.20 () {58 vars in 1218 bytes} [Sat Jul 30 05:08:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-876609958 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 05:08:43.388564 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-f5e28895-594f-48bd-98bc-02094e0ac42b tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Action: 'create', calling method: .version_select at 0x7f2db4108ee0>, body: {"keypair": {"name": "tempest-keypair-844669600", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKAruWituhxze7TGvDMSF/BBZ0dZC9874gA0WxZa1SySeswUuCcL2LVyFdrLjiBNvFjZMl9mv064XbT5UTrVxanDLlyEixVJ6DeozDeLef+NpRkauxn6F0x3TmabM1BXeQ=="}} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:08:43.404994 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.quota [None req-f5e28895-594f-48bd-98bc-02094e0ac42b tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Getting quotas for project d9f8c70dc5de488698a8ab775c618088. Resources: {'key_pairs'} {{(pid=117885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 05:08:43.409505 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.quota [None req-f5e28895-594f-48bd-98bc-02094e0ac42b tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Getting quotas for user 3a805f5dec66484c8d950b6bc52e3e03 and project d9f8c70dc5de488698a8ab775c618088. Resources: {'key_pairs'} {{(pid=117885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 05:08:43.436169 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-f5e28895-594f-48bd-98bc-02094e0ac42b tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.051428 Jul 30 05:08:43.436811 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 559/1166] 10.222.0.20 () {60 vars in 1159 bytes} [Sat Jul 30 05:08:43 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 05:08:43.883750 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-a0c465ea-01b6-4d1a-816b-1d4b5da22f27 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:08:43.885035 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-a0c465ea-01b6-4d1a-816b-1d4b5da22f27 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] [instance: 2044debc-6b41-413e-ac3d-89a4cca33a13] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:08:43.891975 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-1782a531-d6e4-4b23-9263-65a9f5411d63 req-12fd1384-a0a8-4f1f-9837-4a06dbad1492 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2044debc-6b41-413e-ac3d-89a4cca33a13", "tag": "d47fd3ca-b5c7-44be-a749-9b228fae6174"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:08:43.900339 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a0c465ea-01b6-4d1a-816b-1d4b5da22f27 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:08:43.900786 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a0c465ea-01b6-4d1a-816b-1d4b5da22f27 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:08:43.901755 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a0c465ea-01b6-4d1a-816b-1d4b5da22f27 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:08:43.902196 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a0c465ea-01b6-4d1a-816b-1d4b5da22f27 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:08:43.914429 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-1782a531-d6e4-4b23-9263-65a9f5411d63 req-12fd1384-a0a8-4f1f-9837-4a06dbad1492 service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:08:43.914908 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-1782a531-d6e4-4b23-9263-65a9f5411d63 req-12fd1384-a0a8-4f1f-9837-4a06dbad1492 service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:08:43.929266 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-a0c465ea-01b6-4d1a-816b-1d4b5da22f27 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] [instance: 2044debc-6b41-413e-ac3d-89a4cca33a13] Going to try to terminate instance {{(pid=117886) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 05:08:43.932076 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-1782a531-d6e4-4b23-9263-65a9f5411d63 req-12fd1384-a0a8-4f1f-9837-4a06dbad1492 service nova] Creating event network-changed:d47fd3ca-b5c7-44be-a749-9b228fae6174 for instance 2044debc-6b41-413e-ac3d-89a4cca33a13 on hv-cinder-85127 Jul 30 05:08:43.940264 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-1782a531-d6e4-4b23-9263-65a9f5411d63 req-12fd1384-a0a8-4f1f-9837-4a06dbad1492 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057084 Jul 30 05:08:43.941028 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 560/1167] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Jul 30 05:08:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 05:08:44.031303 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-a0c465ea-01b6-4d1a-816b-1d4b5da22f27 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2044debc-6b41-413e-ac3d-89a4cca33a13" status: 204 len: 0 microversion: 2.1 time: 0.152203 Jul 30 05:08:44.032634 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 608/1168] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Jul 30 05:08:43 2022] DELETE /compute/v2.1/servers/2044debc-6b41-413e-ac3d-89a4cca33a13 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 05:08:44.041997 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-6c6d8c67-ed0c-4147-ab14-6a258488a2a5 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:08:44.042745 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-6c6d8c67-ed0c-4147-ab14-6a258488a2a5 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] [instance: 2044debc-6b41-413e-ac3d-89a4cca33a13] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:08:44.049588 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6c6d8c67-ed0c-4147-ab14-6a258488a2a5 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:08:44.050305 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6c6d8c67-ed0c-4147-ab14-6a258488a2a5 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:08:44.051148 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6c6d8c67-ed0c-4147-ab14-6a258488a2a5 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:08:44.051589 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-6c6d8c67-ed0c-4147-ab14-6a258488a2a5 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:08:44.203179 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-6c6d8c67-ed0c-4147-ab14-6a258488a2a5 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407ad282edd74fb1adf62fb63306779c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db365a6a9f6041a7a8749fd1a1e3d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:08:44.212435 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-6c6d8c67-ed0c-4147-ab14-6a258488a2a5 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] 10.222.0.20 "GET /compute/v2.1/servers/2044debc-6b41-413e-ac3d-89a4cca33a13" status: 200 len: 1575 microversion: 2.1 time: 0.175138 Jul 30 05:08:44.213255 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 561/1169] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:08:44 2022] GET /compute/v2.1/servers/2044debc-6b41-413e-ac3d-89a4cca33a13 => generated 1575 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 05:08:44.991071 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-ffe5aea9-af8d-40dc-b8e3-fd130f7b7558 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1299541123", "imageRef": "d6a9c8e1-ecb9-4603-bb88-2b0d46ac2387", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "94989f7f-6c27-4232-af89-2c1914199605"}], "security_groups": [{"name": "tempest-securitygroup--2073330974"}], "key_name": "tempest-keypair-844669600", "user_data": "}} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:08:45.097087 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.network.neutron [None req-ffe5aea9-af8d-40dc-b8e3-fd130f7b7558 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] validate_networks() for [('94989f7f-6c27-4232-af89-2c1914199605', None, None, None, None, None)] {{(pid=117886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 30 05:08:45.235866 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-da28c6ba-d77c-4337-af51-c209000fae90 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:08:45.236497 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-da28c6ba-d77c-4337-af51-c209000fae90 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] [instance: 2044debc-6b41-413e-ac3d-89a4cca33a13] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:08:45.243679 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-da28c6ba-d77c-4337-af51-c209000fae90 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:08:45.244132 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-da28c6ba-d77c-4337-af51-c209000fae90 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:08:45.244913 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-da28c6ba-d77c-4337-af51-c209000fae90 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:08:45.245349 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-da28c6ba-d77c-4337-af51-c209000fae90 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:08:45.379410 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-da28c6ba-d77c-4337-af51-c209000fae90 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407ad282edd74fb1adf62fb63306779c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db365a6a9f6041a7a8749fd1a1e3d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:08:45.387541 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-da28c6ba-d77c-4337-af51-c209000fae90 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] 10.222.0.20 "GET /compute/v2.1/servers/2044debc-6b41-413e-ac3d-89a4cca33a13" status: 200 len: 1575 microversion: 2.1 time: 0.156215 Jul 30 05:08:45.388207 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 562/1170] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:08:45 2022] GET /compute/v2.1/servers/2044debc-6b41-413e-ac3d-89a4cca33a13 => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 05:08:45.523385 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-ffe5aea9-af8d-40dc-b8e3-fd130f7b7558 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Flavor limits 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 30 05:08:45.524357 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-ffe5aea9-af8d-40dc-b8e3-fd130f7b7558 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Image limits 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 30 05:08:45.524828 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-ffe5aea9-af8d-40dc-b8e3-fd130f7b7558 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Flavor pref 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 30 05:08:45.525237 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-ffe5aea9-af8d-40dc-b8e3-fd130f7b7558 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Image pref 0:0:0 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 30 05:08:45.525645 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.virt.hardware [None req-ffe5aea9-af8d-40dc-b8e3-fd130f7b7558 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 30 05:08:45.534569 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ffe5aea9-af8d-40dc-b8e3-fd130f7b7558 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:08:45.535016 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ffe5aea9-af8d-40dc-b8e3-fd130f7b7558 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:08:45.535804 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ffe5aea9-af8d-40dc-b8e3-fd130f7b7558 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:08:45.536240 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-ffe5aea9-af8d-40dc-b8e3-fd130f7b7558 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:08:45.553407 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.quota [None req-ffe5aea9-af8d-40dc-b8e3-fd130f7b7558 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Getting quotas for project d9f8c70dc5de488698a8ab775c618088. Resources: {'ram', 'cores', 'instances'} {{(pid=117886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 30 05:08:45.557273 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.quota [None req-ffe5aea9-af8d-40dc-b8e3-fd130f7b7558 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Getting quotas for user 3a805f5dec66484c8d950b6bc52e3e03 and project d9f8c70dc5de488698a8ab775c618088. Resources: {'ram', 'cores', 'instances'} {{(pid=117886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 30 05:08:45.568609 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-ffe5aea9-af8d-40dc-b8e3-fd130f7b7558 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Going to run 1 instances... {{(pid=117886) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 30 05:08:45.570952 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-ffe5aea9-af8d-40dc-b8e3-fd130f7b7558 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] [instance: 8fd2f208-dd3d-4ea2-b97f-5c70404be701] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d6a9c8e1-ecb9-4603-bb88-2b0d46ac2387',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 30 05:08:45.619254 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-ffe5aea9-af8d-40dc-b8e3-fd130f7b7558 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.632755 Jul 30 05:08:45.619895 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 609/1171] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Jul 30 05:08:44 2022] POST /compute/v2.1/servers => generated 402 bytes in 634 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 30 05:08:45.632300 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-fe2bd593-be3a-47e8-bcad-9afd4eec556e tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:08:45.633398 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-fe2bd593-be3a-47e8-bcad-9afd4eec556e tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] [instance: 8fd2f208-dd3d-4ea2-b97f-5c70404be701] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:08:45.723694 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-fe2bd593-be3a-47e8-bcad-9afd4eec556e tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a805f5dec66484c8d950b6bc52e3e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f8c70dc5de488698a8ab775c618088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:08:45.730710 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-fe2bd593-be3a-47e8-bcad-9afd4eec556e tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] 10.222.0.20 "GET /compute/v2.1/servers/8fd2f208-dd3d-4ea2-b97f-5c70404be701" status: 200 len: 1237 microversion: 2.1 time: 0.102515 Jul 30 05:08:45.731302 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 563/1172] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:08:45 2022] GET /compute/v2.1/servers/8fd2f208-dd3d-4ea2-b97f-5c70404be701 => generated 1237 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:08:46.194813 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-a2cceee7-a84a-434d-8356-278eeb20797c req-89c05fd8-8c18-4eb7-8705-8262eccf056d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2044debc-6b41-413e-ac3d-89a4cca33a13", "name": "network-vif-deleted", "tag": "d47fd3ca-b5c7-44be-a749-9b228fae6174"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:08:46.205407 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-a2cceee7-a84a-434d-8356-278eeb20797c req-89c05fd8-8c18-4eb7-8705-8262eccf056d service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:08:46.205922 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-a2cceee7-a84a-434d-8356-278eeb20797c req-89c05fd8-8c18-4eb7-8705-8262eccf056d service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:08:46.217938 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-a2cceee7-a84a-434d-8356-278eeb20797c req-89c05fd8-8c18-4eb7-8705-8262eccf056d service nova] Creating event network-vif-deleted:d47fd3ca-b5c7-44be-a749-9b228fae6174 for instance 2044debc-6b41-413e-ac3d-89a4cca33a13 on hv-cinder-85127 Jul 30 05:08:46.223353 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-a2cceee7-a84a-434d-8356-278eeb20797c req-89c05fd8-8c18-4eb7-8705-8262eccf056d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032965 Jul 30 05:08:46.224259 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 610/1173] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Jul 30 05:08:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 05:08:46.408095 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-e7ef7d64-7bb5-4047-ba9d-942d3963a297 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:08:46.408648 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-e7ef7d64-7bb5-4047-ba9d-942d3963a297 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] [instance: 2044debc-6b41-413e-ac3d-89a4cca33a13] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:08:46.415038 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e7ef7d64-7bb5-4047-ba9d-942d3963a297 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:08:46.415490 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e7ef7d64-7bb5-4047-ba9d-942d3963a297 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:08:46.416527 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e7ef7d64-7bb5-4047-ba9d-942d3963a297 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:08:46.416960 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e7ef7d64-7bb5-4047-ba9d-942d3963a297 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:08:46.479821 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-e7ef7d64-7bb5-4047-ba9d-942d3963a297 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407ad282edd74fb1adf62fb63306779c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db365a6a9f6041a7a8749fd1a1e3d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:08:46.488130 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-e7ef7d64-7bb5-4047-ba9d-942d3963a297 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] 10.222.0.20 "GET /compute/v2.1/servers/2044debc-6b41-413e-ac3d-89a4cca33a13" status: 200 len: 1225 microversion: 2.1 time: 0.083965 Jul 30 05:08:46.488707 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 564/1174] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:08:46 2022] GET /compute/v2.1/servers/2044debc-6b41-413e-ac3d-89a4cca33a13 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:08:46.753152 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-e4f2e2f3-28c0-475f-bf64-daaec0b87f70 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:08:46.753882 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-e4f2e2f3-28c0-475f-bf64-daaec0b87f70 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] [instance: 8fd2f208-dd3d-4ea2-b97f-5c70404be701] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:08:46.760067 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e4f2e2f3-28c0-475f-bf64-daaec0b87f70 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:08:46.760451 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e4f2e2f3-28c0-475f-bf64-daaec0b87f70 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:08:46.761224 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e4f2e2f3-28c0-475f-bf64-daaec0b87f70 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:08:46.761655 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e4f2e2f3-28c0-475f-bf64-daaec0b87f70 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:08:46.824929 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-e4f2e2f3-28c0-475f-bf64-daaec0b87f70 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a805f5dec66484c8d950b6bc52e3e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f8c70dc5de488698a8ab775c618088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:08:46.836536 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-e4f2e2f3-28c0-475f-bf64-daaec0b87f70 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] 10.222.0.20 "GET /compute/v2.1/servers/8fd2f208-dd3d-4ea2-b97f-5c70404be701" status: 200 len: 1307 microversion: 2.1 time: 0.088511 Jul 30 05:08:46.837470 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 611/1175] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:08:46 2022] GET /compute/v2.1/servers/8fd2f208-dd3d-4ea2-b97f-5c70404be701 => generated 1307 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:08:47.509165 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-dce738aa-cac3-4c67-a94d-27830d1ea4e5 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:08:47.509795 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-dce738aa-cac3-4c67-a94d-27830d1ea4e5 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] [instance: 2044debc-6b41-413e-ac3d-89a4cca33a13] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:08:47.517366 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-dce738aa-cac3-4c67-a94d-27830d1ea4e5 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:08:47.517921 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-dce738aa-cac3-4c67-a94d-27830d1ea4e5 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:08:47.518885 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-dce738aa-cac3-4c67-a94d-27830d1ea4e5 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:08:47.519333 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-dce738aa-cac3-4c67-a94d-27830d1ea4e5 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:08:47.535224 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.wsgi [None req-dce738aa-cac3-4c67-a94d-27830d1ea4e5 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] HTTP exception thrown: Instance 2044debc-6b41-413e-ac3d-89a4cca33a13 could not be found. Jul 30 05:08:47.536953 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-dce738aa-cac3-4c67-a94d-27830d1ea4e5 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Request method failure captured: Jul 30 05:08:47.536953 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: request: GET /compute/v2.1/servers/2044debc-6b41-413e-ac3d-89a4cca33a13 HTTP/1.1 Jul 30 05:08:47.536953 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Accept: application/json Jul 30 05:08:47.536953 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Accept-Encoding: identity Jul 30 05:08:47.536953 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Connection: close Jul 30 05:08:47.536953 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Content-Length: 0 Jul 30 05:08:47.536953 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Content-Type: application/json Jul 30 05:08:47.536953 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Host: 10.222.0.20 Jul 30 05:08:47.536953 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Openstack-System-Scope: None Jul 30 05:08:47.536953 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: User-Agent: python-urllib3/1.26.10 Jul 30 05:08:47.536953 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Auth-Token: gAAAAABi5LsFP9OEche5y4lXG8VwGjqGB-lqgOtZrs-5_9c2R6Ag-8NJaxcwTtiw3SgdSFybZr7J-RfHRufrRc3qDvPG20s46MHR8DjH4ANvKOo1Trrkozk2BziuELSDEtqCND7Enojbk0EIGZsF5tf92zb61OWPzHEQzgEVzNlSDTTbdyS26ok Jul 30 05:08:47.536953 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Domain-Id: None Jul 30 05:08:47.536953 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Domain-Name: None Jul 30 05:08:47.536953 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Identity-Status: Confirmed Jul 30 05:08:47.536953 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Is-Admin-Project: True Jul 30 05:08:47.536953 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Domain-Id: default Jul 30 05:08:47.536953 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Domain-Name: Default Jul 30 05:08:47.536953 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Id: db365a6a9f6041a7a8749fd1a1e3d488 Jul 30 05:08:47.536953 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Name: tempest-TestVolumeBootPattern-2000315609 Jul 30 05:08:47.536953 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Role: member,reader Jul 30 05:08:47.536953 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Roles: member,reader Jul 30 05:08:47.538657 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/db365a6a9f6041a7a8749fd1a1e3d488"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/db365a6a9f6041a7a8749fd1a1e3d488"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_db365a6a9f6041a7a8749fd1a1e3d488"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/db365a6a9f6041a7a8749fd1a1e3d488"}]}] Jul 30 05:08:47.538657 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Tenant: tempest-TestVolumeBootPattern-2000315609 Jul 30 05:08:47.538657 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Tenant-Id: db365a6a9f6041a7a8749fd1a1e3d488 Jul 30 05:08:47.538657 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Tenant-Name: tempest-TestVolumeBootPattern-2000315609 Jul 30 05:08:47.538657 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User: tempest-TestVolumeBootPattern-2000315609-project Jul 30 05:08:47.538657 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Domain-Id: default Jul 30 05:08:47.538657 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Domain-Name: Default Jul 30 05:08:47.538657 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Id: 407ad282edd74fb1adf62fb63306779c Jul 30 05:08:47.538657 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Name: tempest-TestVolumeBootPattern-2000315609-project Jul 30 05:08:47.538657 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: method: > Jul 30 05:08:47.538657 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: exception: Instance 2044debc-6b41-413e-ac3d-89a4cca33a13 could not be found. Jul 30 05:08:47.538657 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: action_args: {'id': '2044debc-6b41-413e-ac3d-89a4cca33a13'} Jul 30 05:08:47.543536 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 05:08:47.543536 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:08:47.543536 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 05:08:47.543536 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 05:08:47.543536 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 05:08:47.543536 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 05:08:47.543536 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 05:08:47.543536 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 05:08:47.543536 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 05:08:47.543536 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 05:08:47.543536 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2044debc-6b41-413e-ac3d-89a4cca33a13 could not be found. Jul 30 05:08:47.543536 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:08:47.543536 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 05:08:47.543536 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:08:47.543536 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:08:47.543536 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 05:08:47.543536 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 05:08:47.543536 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 05:08:47.543536 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 05:08:47.543536 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 05:08:47.545039 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 05:08:47.545039 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 05:08:47.545039 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 05:08:47.545039 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 05:08:47.545039 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 05:08:47.545039 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 05:08:47.545039 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 05:08:47.545039 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2044debc-6b41-413e-ac3d-89a4cca33a13 could not be found. Jul 30 05:08:47.545039 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:08:47.545039 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 05:08:47.545039 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:08:47.545039 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:08:47.545039 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 05:08:47.545039 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 05:08:47.545039 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 05:08:47.545039 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 05:08:47.545039 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2044debc-6b41-413e-ac3d-89a4cca33a13 could not be found. Jul 30 05:08:47.545039 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:08:47.546469 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-dce738aa-cac3-4c67-a94d-27830d1ea4e5 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Returning 404 to user: Instance 2044debc-6b41-413e-ac3d-89a4cca33a13 could not be found. {{(pid=117885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 05:08:47.546469 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-dce738aa-cac3-4c67-a94d-27830d1ea4e5 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] 10.222.0.20 "GET /compute/v2.1/servers/2044debc-6b41-413e-ac3d-89a4cca33a13" status: 404 len: 111 microversion: 2.1 time: 0.033100 Jul 30 05:08:47.546469 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 565/1176] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:08:47 2022] GET /compute/v2.1/servers/2044debc-6b41-413e-ac3d-89a4cca33a13 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 05:08:47.859061 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-02f60ce0-a412-45e4-8620-d0794abb30e0 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:08:47.860357 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-02f60ce0-a412-45e4-8620-d0794abb30e0 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] [instance: 8fd2f208-dd3d-4ea2-b97f-5c70404be701] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:08:47.868331 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-02f60ce0-a412-45e4-8620-d0794abb30e0 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:08:47.868961 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-02f60ce0-a412-45e4-8620-d0794abb30e0 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:08:47.874680 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-02f60ce0-a412-45e4-8620-d0794abb30e0 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:08:47.875908 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-02f60ce0-a412-45e4-8620-d0794abb30e0 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:08:48.016527 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-02f60ce0-a412-45e4-8620-d0794abb30e0 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a805f5dec66484c8d950b6bc52e3e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f8c70dc5de488698a8ab775c618088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:08:48.024566 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-02f60ce0-a412-45e4-8620-d0794abb30e0 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] 10.222.0.20 "GET /compute/v2.1/servers/8fd2f208-dd3d-4ea2-b97f-5c70404be701" status: 200 len: 1363 microversion: 2.1 time: 0.169631 Jul 30 05:08:48.024928 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 612/1177] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:08:47 2022] GET /compute/v2.1/servers/8fd2f208-dd3d-4ea2-b97f-5c70404be701 => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:08:48.254946 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-db1d6744-5a7a-45ba-849c-29a04cde70d9 req-1c065d3d-6778-4709-8c72-78e1a6625ca1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8fd2f208-dd3d-4ea2-b97f-5c70404be701", "tag": "ac0f2638-da55-4a28-919f-b194d81ff725"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:08:48.268708 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-db1d6744-5a7a-45ba-849c-29a04cde70d9 req-1c065d3d-6778-4709-8c72-78e1a6625ca1 service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:08:48.269247 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-db1d6744-5a7a-45ba-849c-29a04cde70d9 req-1c065d3d-6778-4709-8c72-78e1a6625ca1 service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:08:48.280473 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-db1d6744-5a7a-45ba-849c-29a04cde70d9 req-1c065d3d-6778-4709-8c72-78e1a6625ca1 service nova] Creating event network-changed:ac0f2638-da55-4a28-919f-b194d81ff725 for instance 8fd2f208-dd3d-4ea2-b97f-5c70404be701 on hv-cinder-85127 Jul 30 05:08:48.286056 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-db1d6744-5a7a-45ba-849c-29a04cde70d9 req-1c065d3d-6778-4709-8c72-78e1a6625ca1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038039 Jul 30 05:08:48.286994 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 566/1178] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Jul 30 05:08:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 05:08:49.045689 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-7deda7e6-8b24-4114-a3ff-8ecacd11f485 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:08:49.046389 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-7deda7e6-8b24-4114-a3ff-8ecacd11f485 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] [instance: 8fd2f208-dd3d-4ea2-b97f-5c70404be701] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:08:49.052938 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7deda7e6-8b24-4114-a3ff-8ecacd11f485 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:08:49.053451 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7deda7e6-8b24-4114-a3ff-8ecacd11f485 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:08:49.054499 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7deda7e6-8b24-4114-a3ff-8ecacd11f485 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:08:49.054953 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7deda7e6-8b24-4114-a3ff-8ecacd11f485 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:08:49.183191 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-7deda7e6-8b24-4114-a3ff-8ecacd11f485 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a805f5dec66484c8d950b6bc52e3e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f8c70dc5de488698a8ab775c618088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:08:49.191183 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-7deda7e6-8b24-4114-a3ff-8ecacd11f485 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] 10.222.0.20 "GET /compute/v2.1/servers/8fd2f208-dd3d-4ea2-b97f-5c70404be701" status: 200 len: 1363 microversion: 2.1 time: 0.149555 Jul 30 05:08:49.191766 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 613/1179] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:08:49 2022] GET /compute/v2.1/servers/8fd2f208-dd3d-4ea2-b97f-5c70404be701 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:08:50.214264 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-72d4a6db-9854-4db5-a476-871878e476f4 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:08:50.215014 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-72d4a6db-9854-4db5-a476-871878e476f4 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] [instance: 8fd2f208-dd3d-4ea2-b97f-5c70404be701] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:08:50.221430 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-72d4a6db-9854-4db5-a476-871878e476f4 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:08:50.221887 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-72d4a6db-9854-4db5-a476-871878e476f4 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:08:50.222693 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-72d4a6db-9854-4db5-a476-871878e476f4 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:08:50.223143 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-72d4a6db-9854-4db5-a476-871878e476f4 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:08:50.352976 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-72d4a6db-9854-4db5-a476-871878e476f4 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a805f5dec66484c8d950b6bc52e3e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f8c70dc5de488698a8ab775c618088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:08:50.361139 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-72d4a6db-9854-4db5-a476-871878e476f4 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] 10.222.0.20 "GET /compute/v2.1/servers/8fd2f208-dd3d-4ea2-b97f-5c70404be701" status: 200 len: 1363 microversion: 2.1 time: 0.151687 Jul 30 05:08:50.361704 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 567/1180] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:08:50 2022] GET /compute/v2.1/servers/8fd2f208-dd3d-4ea2-b97f-5c70404be701 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:08:50.622680 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-1a87d881-7cfb-4763-aab2-e3c36914576d tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:08:50.623166 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-1a87d881-7cfb-4763-aab2-e3c36914576d tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] [instance: 8520739a-9a63-4295-843a-b86a4aa10cab] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:08:50.625870 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-b4a2281a-f2ce-4f15-93e4-85cf677fce63 req-f8292f4d-e1d3-418d-a032-8b7e30456068 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8520739a-9a63-4295-843a-b86a4aa10cab", "tag": "2044be95-863c-488f-8fdd-ec89733220ef"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:08:50.629723 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1a87d881-7cfb-4763-aab2-e3c36914576d tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:08:50.630196 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1a87d881-7cfb-4763-aab2-e3c36914576d tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:08:50.631236 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1a87d881-7cfb-4763-aab2-e3c36914576d tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:08:50.631671 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-1a87d881-7cfb-4763-aab2-e3c36914576d tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:08:50.635780 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-b4a2281a-f2ce-4f15-93e4-85cf677fce63 req-f8292f4d-e1d3-418d-a032-8b7e30456068 service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:08:50.636299 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-b4a2281a-f2ce-4f15-93e4-85cf677fce63 req-f8292f4d-e1d3-418d-a032-8b7e30456068 service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:08:50.648169 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-b4a2281a-f2ce-4f15-93e4-85cf677fce63 req-f8292f4d-e1d3-418d-a032-8b7e30456068 service nova] Creating event network-changed:2044be95-863c-488f-8fdd-ec89733220ef for instance 8520739a-9a63-4295-843a-b86a4aa10cab on hv-cinder-85127 Jul 30 05:08:50.653613 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-b4a2281a-f2ce-4f15-93e4-85cf677fce63 req-f8292f4d-e1d3-418d-a032-8b7e30456068 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032553 Jul 30 05:08:50.654295 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 568/1181] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Jul 30 05:08:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 30 05:08:50.668156 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-1a87d881-7cfb-4763-aab2-e3c36914576d tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] [instance: 8520739a-9a63-4295-843a-b86a4aa10cab] Going to try to terminate instance {{(pid=117886) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 05:08:50.753828 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-1a87d881-7cfb-4763-aab2-e3c36914576d tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8520739a-9a63-4295-843a-b86a4aa10cab" status: 204 len: 0 microversion: 2.1 time: 0.135481 Jul 30 05:08:50.763018 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-10b27146-dc60-4d9e-a30e-7fba72f41451 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:08:50.763719 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-10b27146-dc60-4d9e-a30e-7fba72f41451 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] [instance: 8520739a-9a63-4295-843a-b86a4aa10cab] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:08:50.766555 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 614/1182] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Jul 30 05:08:50 2022] DELETE /compute/v2.1/servers/8520739a-9a63-4295-843a-b86a4aa10cab => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 05:08:50.771095 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-10b27146-dc60-4d9e-a30e-7fba72f41451 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:08:50.771549 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-10b27146-dc60-4d9e-a30e-7fba72f41451 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:08:50.772321 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-10b27146-dc60-4d9e-a30e-7fba72f41451 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:08:50.772953 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-10b27146-dc60-4d9e-a30e-7fba72f41451 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:08:50.943774 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-10b27146-dc60-4d9e-a30e-7fba72f41451 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407ad282edd74fb1adf62fb63306779c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db365a6a9f6041a7a8749fd1a1e3d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:08:50.951604 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-10b27146-dc60-4d9e-a30e-7fba72f41451 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] 10.222.0.20 "GET /compute/v2.1/servers/8520739a-9a63-4295-843a-b86a4aa10cab" status: 200 len: 1576 microversion: 2.1 time: 0.192786 Jul 30 05:08:50.952175 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 569/1183] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:08:50 2022] GET /compute/v2.1/servers/8520739a-9a63-4295-843a-b86a4aa10cab => generated 1576 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:08:51.382507 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-bdcc3a9d-3456-406e-ade3-0688e9cfcd07 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:08:51.383693 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-bdcc3a9d-3456-406e-ade3-0688e9cfcd07 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] [instance: 8fd2f208-dd3d-4ea2-b97f-5c70404be701] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:08:51.389812 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bdcc3a9d-3456-406e-ade3-0688e9cfcd07 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:08:51.390264 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bdcc3a9d-3456-406e-ade3-0688e9cfcd07 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:08:51.391464 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bdcc3a9d-3456-406e-ade3-0688e9cfcd07 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:08:51.391905 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-bdcc3a9d-3456-406e-ade3-0688e9cfcd07 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:08:51.536904 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-bdcc3a9d-3456-406e-ade3-0688e9cfcd07 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a805f5dec66484c8d950b6bc52e3e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f8c70dc5de488698a8ab775c618088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:08:51.544947 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-bdcc3a9d-3456-406e-ade3-0688e9cfcd07 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] 10.222.0.20 "GET /compute/v2.1/servers/8fd2f208-dd3d-4ea2-b97f-5c70404be701" status: 200 len: 1363 microversion: 2.1 time: 0.167426 Jul 30 05:08:51.545527 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 615/1184] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:08:51 2022] GET /compute/v2.1/servers/8fd2f208-dd3d-4ea2-b97f-5c70404be701 => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:08:51.974601 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-9f4d8d94-bd8a-4b69-a3c7-f0244b7394fd tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:08:51.975358 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-9f4d8d94-bd8a-4b69-a3c7-f0244b7394fd tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] [instance: 8520739a-9a63-4295-843a-b86a4aa10cab] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:08:51.982214 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9f4d8d94-bd8a-4b69-a3c7-f0244b7394fd tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:08:51.982882 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9f4d8d94-bd8a-4b69-a3c7-f0244b7394fd tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:08:51.983772 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9f4d8d94-bd8a-4b69-a3c7-f0244b7394fd tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:08:51.984345 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-9f4d8d94-bd8a-4b69-a3c7-f0244b7394fd tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:08:52.151786 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-9f4d8d94-bd8a-4b69-a3c7-f0244b7394fd tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407ad282edd74fb1adf62fb63306779c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db365a6a9f6041a7a8749fd1a1e3d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:08:52.161372 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-9f4d8d94-bd8a-4b69-a3c7-f0244b7394fd tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] 10.222.0.20 "GET /compute/v2.1/servers/8520739a-9a63-4295-843a-b86a4aa10cab" status: 200 len: 1576 microversion: 2.1 time: 0.190517 Jul 30 05:08:52.162247 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 570/1185] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:08:51 2022] GET /compute/v2.1/servers/8520739a-9a63-4295-843a-b86a4aa10cab => generated 1576 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:08:52.566215 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-64efac3b-abbd-46e0-93f5-3575f900fce8 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:08:52.566874 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-64efac3b-abbd-46e0-93f5-3575f900fce8 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] [instance: 8fd2f208-dd3d-4ea2-b97f-5c70404be701] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:08:52.573272 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-64efac3b-abbd-46e0-93f5-3575f900fce8 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:08:52.573712 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-64efac3b-abbd-46e0-93f5-3575f900fce8 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:08:52.574502 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-64efac3b-abbd-46e0-93f5-3575f900fce8 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:08:52.574937 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-64efac3b-abbd-46e0-93f5-3575f900fce8 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:08:52.712853 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-64efac3b-abbd-46e0-93f5-3575f900fce8 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a805f5dec66484c8d950b6bc52e3e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f8c70dc5de488698a8ab775c618088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:08:52.730719 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-64efac3b-abbd-46e0-93f5-3575f900fce8 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] 10.222.0.20 "GET /compute/v2.1/servers/8fd2f208-dd3d-4ea2-b97f-5c70404be701" status: 200 len: 1363 microversion: 2.1 time: 0.168597 Jul 30 05:08:52.731341 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 616/1186] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:08:52 2022] GET /compute/v2.1/servers/8fd2f208-dd3d-4ea2-b97f-5c70404be701 => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:08:52.768633 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-7d20b207-9300-4eac-9a1c-cb4c4bb46380 req-288cc333-1682-4c2d-b9d0-a05613ca4718 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8520739a-9a63-4295-843a-b86a4aa10cab", "name": "network-vif-deleted", "tag": "2044be95-863c-488f-8fdd-ec89733220ef"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:08:52.778115 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-7d20b207-9300-4eac-9a1c-cb4c4bb46380 req-288cc333-1682-4c2d-b9d0-a05613ca4718 service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:08:52.778596 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-7d20b207-9300-4eac-9a1c-cb4c4bb46380 req-288cc333-1682-4c2d-b9d0-a05613ca4718 service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:08:52.789747 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-7d20b207-9300-4eac-9a1c-cb4c4bb46380 req-288cc333-1682-4c2d-b9d0-a05613ca4718 service nova] Creating event network-vif-deleted:2044be95-863c-488f-8fdd-ec89733220ef for instance 8520739a-9a63-4295-843a-b86a4aa10cab on hv-cinder-85127 Jul 30 05:08:52.794668 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-7d20b207-9300-4eac-9a1c-cb4c4bb46380 req-288cc333-1682-4c2d-b9d0-a05613ca4718 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095127 Jul 30 05:08:52.795270 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 571/1187] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Jul 30 05:08:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 05:08:53.183192 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-f23552e1-719f-45b8-ab7a-5bd67ac3b0e3 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:08:53.183805 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-f23552e1-719f-45b8-ab7a-5bd67ac3b0e3 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] [instance: 8520739a-9a63-4295-843a-b86a4aa10cab] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:08:53.190944 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f23552e1-719f-45b8-ab7a-5bd67ac3b0e3 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:08:53.191397 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f23552e1-719f-45b8-ab7a-5bd67ac3b0e3 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:08:53.192159 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f23552e1-719f-45b8-ab7a-5bd67ac3b0e3 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:08:53.192594 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f23552e1-719f-45b8-ab7a-5bd67ac3b0e3 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:08:53.223605 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f23552e1-719f-45b8-ab7a-5bd67ac3b0e3 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:08:53.224087 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f23552e1-719f-45b8-ab7a-5bd67ac3b0e3 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:08:53.224546 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.objects.instance [None req-f23552e1-719f-45b8-ab7a-5bd67ac3b0e3 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lazy-loading 'fault' on Instance uuid 8520739a-9a63-4295-843a-b86a4aa10cab {{(pid=117886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 05:08:53.266907 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-f23552e1-719f-45b8-ab7a-5bd67ac3b0e3 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '407ad282edd74fb1adf62fb63306779c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db365a6a9f6041a7a8749fd1a1e3d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:08:53.274395 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-f23552e1-719f-45b8-ab7a-5bd67ac3b0e3 tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] 10.222.0.20 "GET /compute/v2.1/servers/8520739a-9a63-4295-843a-b86a4aa10cab" status: 200 len: 1230 microversion: 2.1 time: 0.095059 Jul 30 05:08:53.274986 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 617/1188] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:08:53 2022] GET /compute/v2.1/servers/8520739a-9a63-4295-843a-b86a4aa10cab => generated 1230 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:08:53.576824 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-699a300f-bd55-457f-9887-9701836dffc8 req-0926c851-bad7-4390-abd7-f664f7478a2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fd2f208-dd3d-4ea2-b97f-5c70404be701", "name": "network-vif-plugged", "status": "completed", "tag": "ac0f2638-da55-4a28-919f-b194d81ff725"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:08:53.587947 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-699a300f-bd55-457f-9887-9701836dffc8 req-0926c851-bad7-4390-abd7-f664f7478a2f service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:08:53.588403 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-699a300f-bd55-457f-9887-9701836dffc8 req-0926c851-bad7-4390-abd7-f664f7478a2f service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:08:53.599854 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-699a300f-bd55-457f-9887-9701836dffc8 req-0926c851-bad7-4390-abd7-f664f7478a2f service nova] Creating event network-vif-plugged:ac0f2638-da55-4a28-919f-b194d81ff725 for instance 8fd2f208-dd3d-4ea2-b97f-5c70404be701 on hv-cinder-85127 Jul 30 05:08:53.604560 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-699a300f-bd55-457f-9887-9701836dffc8 req-0926c851-bad7-4390-abd7-f664f7478a2f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032450 Jul 30 05:08:53.605140 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 572/1189] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Jul 30 05:08:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 05:08:53.754141 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-7c0bce14-16c0-4d76-a977-97170fcfe5f9 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:08:53.754945 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-7c0bce14-16c0-4d76-a977-97170fcfe5f9 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] [instance: 8fd2f208-dd3d-4ea2-b97f-5c70404be701] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:08:53.761441 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7c0bce14-16c0-4d76-a977-97170fcfe5f9 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:08:53.761898 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7c0bce14-16c0-4d76-a977-97170fcfe5f9 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:08:53.762700 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7c0bce14-16c0-4d76-a977-97170fcfe5f9 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:08:53.763157 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7c0bce14-16c0-4d76-a977-97170fcfe5f9 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:08:53.767267 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:08:54.160849 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-7c0bce14-16c0-4d76-a977-97170fcfe5f9 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a805f5dec66484c8d950b6bc52e3e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f8c70dc5de488698a8ab775c618088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:08:54.168769 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-7c0bce14-16c0-4d76-a977-97170fcfe5f9 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] 10.222.0.20 "GET /compute/v2.1/servers/8fd2f208-dd3d-4ea2-b97f-5c70404be701" status: 200 len: 1363 microversion: 2.1 time: 0.419381 Jul 30 05:08:54.169328 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 618/1190] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:08:53 2022] GET /compute/v2.1/servers/8fd2f208-dd3d-4ea2-b97f-5c70404be701 => generated 1363 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:08:54.297577 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-8365251b-65bc-43e7-892e-15f9a8abb27e tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:08:54.298400 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-8365251b-65bc-43e7-892e-15f9a8abb27e tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] [instance: 8520739a-9a63-4295-843a-b86a4aa10cab] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:08:54.304620 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8365251b-65bc-43e7-892e-15f9a8abb27e tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:08:54.305077 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8365251b-65bc-43e7-892e-15f9a8abb27e tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:08:54.305848 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8365251b-65bc-43e7-892e-15f9a8abb27e tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:08:54.306290 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8365251b-65bc-43e7-892e-15f9a8abb27e tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:08:54.319839 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.wsgi [None req-8365251b-65bc-43e7-892e-15f9a8abb27e tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] HTTP exception thrown: Instance 8520739a-9a63-4295-843a-b86a4aa10cab could not be found. Jul 30 05:08:54.321445 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-8365251b-65bc-43e7-892e-15f9a8abb27e tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Request method failure captured: Jul 30 05:08:54.321445 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: request: GET /compute/v2.1/servers/8520739a-9a63-4295-843a-b86a4aa10cab HTTP/1.1 Jul 30 05:08:54.321445 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Accept: application/json Jul 30 05:08:54.321445 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Accept-Encoding: identity Jul 30 05:08:54.321445 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Connection: close Jul 30 05:08:54.321445 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Content-Length: 0 Jul 30 05:08:54.321445 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Content-Type: application/json Jul 30 05:08:54.321445 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Host: 10.222.0.20 Jul 30 05:08:54.321445 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Openstack-System-Scope: None Jul 30 05:08:54.321445 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: User-Agent: python-urllib3/1.26.10 Jul 30 05:08:54.321445 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Auth-Token: gAAAAABi5LsFP9OEche5y4lXG8VwGjqGB-lqgOtZrs-5_9c2R6Ag-8NJaxcwTtiw3SgdSFybZr7J-RfHRufrRc3qDvPG20s46MHR8DjH4ANvKOo1Trrkozk2BziuELSDEtqCND7Enojbk0EIGZsF5tf92zb61OWPzHEQzgEVzNlSDTTbdyS26ok Jul 30 05:08:54.321445 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Domain-Id: None Jul 30 05:08:54.321445 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Domain-Name: None Jul 30 05:08:54.321445 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Identity-Status: Confirmed Jul 30 05:08:54.321445 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Is-Admin-Project: True Jul 30 05:08:54.321445 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Domain-Id: default Jul 30 05:08:54.321445 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Domain-Name: Default Jul 30 05:08:54.321445 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Id: db365a6a9f6041a7a8749fd1a1e3d488 Jul 30 05:08:54.321445 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Name: tempest-TestVolumeBootPattern-2000315609 Jul 30 05:08:54.321445 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Role: member,reader Jul 30 05:08:54.321445 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Roles: member,reader Jul 30 05:08:54.323062 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/db365a6a9f6041a7a8749fd1a1e3d488"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/db365a6a9f6041a7a8749fd1a1e3d488"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_db365a6a9f6041a7a8749fd1a1e3d488"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/db365a6a9f6041a7a8749fd1a1e3d488"}]}] Jul 30 05:08:54.323062 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Tenant: tempest-TestVolumeBootPattern-2000315609 Jul 30 05:08:54.323062 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Tenant-Id: db365a6a9f6041a7a8749fd1a1e3d488 Jul 30 05:08:54.323062 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Tenant-Name: tempest-TestVolumeBootPattern-2000315609 Jul 30 05:08:54.323062 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User: tempest-TestVolumeBootPattern-2000315609-project Jul 30 05:08:54.323062 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Domain-Id: default Jul 30 05:08:54.323062 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Domain-Name: Default Jul 30 05:08:54.323062 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Id: 407ad282edd74fb1adf62fb63306779c Jul 30 05:08:54.323062 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Name: tempest-TestVolumeBootPattern-2000315609-project Jul 30 05:08:54.323062 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: method: > Jul 30 05:08:54.323062 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: exception: Instance 8520739a-9a63-4295-843a-b86a4aa10cab could not be found. Jul 30 05:08:54.323062 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: action_args: {'id': '8520739a-9a63-4295-843a-b86a4aa10cab'} Jul 30 05:08:54.323980 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 05:08:54.323980 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:08:54.323980 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 05:08:54.323980 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 05:08:54.323980 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 05:08:54.323980 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 05:08:54.323980 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 05:08:54.323980 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 05:08:54.323980 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 05:08:54.323980 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 05:08:54.323980 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8520739a-9a63-4295-843a-b86a4aa10cab could not be found. Jul 30 05:08:54.323980 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:08:54.323980 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 05:08:54.323980 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:08:54.323980 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:08:54.323980 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 05:08:54.323980 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 05:08:54.323980 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 05:08:54.323980 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 05:08:54.323980 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 05:08:54.325483 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 05:08:54.325483 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 05:08:54.325483 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 05:08:54.325483 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 05:08:54.325483 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 05:08:54.325483 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 05:08:54.325483 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 05:08:54.325483 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8520739a-9a63-4295-843a-b86a4aa10cab could not be found. Jul 30 05:08:54.325483 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:08:54.325483 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 05:08:54.325483 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:08:54.325483 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:08:54.325483 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 05:08:54.325483 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 05:08:54.325483 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 05:08:54.325483 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 05:08:54.325483 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8520739a-9a63-4295-843a-b86a4aa10cab could not be found. Jul 30 05:08:54.325483 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:08:54.326836 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-8365251b-65bc-43e7-892e-15f9a8abb27e tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Returning 404 to user: Instance 8520739a-9a63-4295-843a-b86a4aa10cab could not be found. {{(pid=117885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 05:08:54.326836 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-8365251b-65bc-43e7-892e-15f9a8abb27e tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] 10.222.0.20 "GET /compute/v2.1/servers/8520739a-9a63-4295-843a-b86a4aa10cab" status: 404 len: 111 microversion: 2.1 time: 0.029739 Jul 30 05:08:54.326836 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 573/1191] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:08:54 2022] GET /compute/v2.1/servers/8520739a-9a63-4295-843a-b86a4aa10cab => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 05:08:54.760292 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-b8a2d9eb-9bb2-48cc-98b7-1134c4d7fabd tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:08:54.761018 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-b8a2d9eb-9bb2-48cc-98b7-1134c4d7fabd tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] [instance: 267d974a-0a42-4e11-ada0-68e101c4a48f] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:08:54.768748 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b8a2d9eb-9bb2-48cc-98b7-1134c4d7fabd tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:08:54.769226 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b8a2d9eb-9bb2-48cc-98b7-1134c4d7fabd tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:08:54.770059 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b8a2d9eb-9bb2-48cc-98b7-1134c4d7fabd tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:08:54.770524 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-b8a2d9eb-9bb2-48cc-98b7-1134c4d7fabd tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:08:54.785724 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.wsgi [None req-b8a2d9eb-9bb2-48cc-98b7-1134c4d7fabd tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] HTTP exception thrown: Instance 267d974a-0a42-4e11-ada0-68e101c4a48f could not be found. Jul 30 05:08:54.787730 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-b8a2d9eb-9bb2-48cc-98b7-1134c4d7fabd tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Request method failure captured: Jul 30 05:08:54.787730 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: request: DELETE /compute/v2.1/servers/267d974a-0a42-4e11-ada0-68e101c4a48f HTTP/1.1 Jul 30 05:08:54.787730 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Accept: application/json Jul 30 05:08:54.787730 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Accept-Encoding: identity Jul 30 05:08:54.787730 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Connection: close Jul 30 05:08:54.787730 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Content-Length: 0 Jul 30 05:08:54.787730 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Content-Type: application/json Jul 30 05:08:54.787730 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Host: 10.222.0.20 Jul 30 05:08:54.787730 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Openstack-System-Scope: None Jul 30 05:08:54.787730 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: User-Agent: python-urllib3/1.26.10 Jul 30 05:08:54.787730 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Auth-Token: gAAAAABi5LsFP9OEche5y4lXG8VwGjqGB-lqgOtZrs-5_9c2R6Ag-8NJaxcwTtiw3SgdSFybZr7J-RfHRufrRc3qDvPG20s46MHR8DjH4ANvKOo1Trrkozk2BziuELSDEtqCND7Enojbk0EIGZsF5tf92zb61OWPzHEQzgEVzNlSDTTbdyS26ok Jul 30 05:08:54.787730 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Domain-Id: None Jul 30 05:08:54.787730 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Domain-Name: None Jul 30 05:08:54.787730 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Identity-Status: Confirmed Jul 30 05:08:54.787730 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Is-Admin-Project: True Jul 30 05:08:54.787730 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Project-Domain-Id: default Jul 30 05:08:54.787730 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Project-Domain-Name: Default Jul 30 05:08:54.787730 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Project-Id: db365a6a9f6041a7a8749fd1a1e3d488 Jul 30 05:08:54.787730 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Project-Name: tempest-TestVolumeBootPattern-2000315609 Jul 30 05:08:54.787730 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Role: member,reader Jul 30 05:08:54.787730 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Roles: member,reader Jul 30 05:08:54.789187 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/db365a6a9f6041a7a8749fd1a1e3d488"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/db365a6a9f6041a7a8749fd1a1e3d488"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_db365a6a9f6041a7a8749fd1a1e3d488"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/db365a6a9f6041a7a8749fd1a1e3d488"}]}] Jul 30 05:08:54.789187 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Tenant: tempest-TestVolumeBootPattern-2000315609 Jul 30 05:08:54.789187 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Tenant-Id: db365a6a9f6041a7a8749fd1a1e3d488 Jul 30 05:08:54.789187 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Tenant-Name: tempest-TestVolumeBootPattern-2000315609 Jul 30 05:08:54.789187 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User: tempest-TestVolumeBootPattern-2000315609-project Jul 30 05:08:54.789187 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User-Domain-Id: default Jul 30 05:08:54.789187 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User-Domain-Name: Default Jul 30 05:08:54.789187 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User-Id: 407ad282edd74fb1adf62fb63306779c Jul 30 05:08:54.789187 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User-Name: tempest-TestVolumeBootPattern-2000315609-project Jul 30 05:08:54.789187 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: method: > Jul 30 05:08:54.789187 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: exception: Instance 267d974a-0a42-4e11-ada0-68e101c4a48f could not be found. Jul 30 05:08:54.789187 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: action_args: {'id': '267d974a-0a42-4e11-ada0-68e101c4a48f'} Jul 30 05:08:54.789993 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 05:08:54.789993 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:08:54.789993 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 05:08:54.789993 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 05:08:54.789993 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 05:08:54.789993 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 05:08:54.789993 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 05:08:54.789993 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 05:08:54.789993 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 05:08:54.789993 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 05:08:54.789993 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 267d974a-0a42-4e11-ada0-68e101c4a48f could not be found. Jul 30 05:08:54.789993 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 05:08:54.789993 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 05:08:54.789993 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 05:08:54.789993 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:08:54.789993 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 05:08:54.789993 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 05:08:54.789993 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 05:08:54.789993 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 05:08:54.789993 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 05:08:54.791596 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 05:08:54.791596 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 30 05:08:54.791596 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 30 05:08:54.791596 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 30 05:08:54.791596 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 30 05:08:54.791596 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 05:08:54.791596 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 05:08:54.791596 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 05:08:54.791596 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 05:08:54.791596 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 267d974a-0a42-4e11-ada0-68e101c4a48f could not be found. Jul 30 05:08:54.791596 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 05:08:54.791596 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 05:08:54.791596 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 05:08:54.791596 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:08:54.791596 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 05:08:54.791596 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 05:08:54.791596 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 05:08:54.791596 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 05:08:54.791596 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 267d974a-0a42-4e11-ada0-68e101c4a48f could not be found. Jul 30 05:08:54.791596 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 05:08:54.792910 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-b8a2d9eb-9bb2-48cc-98b7-1134c4d7fabd tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Returning 404 to user: Instance 267d974a-0a42-4e11-ada0-68e101c4a48f could not be found. {{(pid=117886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 05:08:54.792910 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-b8a2d9eb-9bb2-48cc-98b7-1134c4d7fabd tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] 10.222.0.20 "DELETE /compute/v2.1/servers/267d974a-0a42-4e11-ada0-68e101c4a48f" status: 404 len: 111 microversion: 2.1 time: 0.036307 Jul 30 05:08:54.792910 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 619/1192] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Jul 30 05:08:54 2022] DELETE /compute/v2.1/servers/267d974a-0a42-4e11-ada0-68e101c4a48f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 05:08:54.799011 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-d6fbd8c3-dae6-48e3-a923-020a040ba50e tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:08:54.799997 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-d6fbd8c3-dae6-48e3-a923-020a040ba50e tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] [instance: 267d974a-0a42-4e11-ada0-68e101c4a48f] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:08:54.806867 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d6fbd8c3-dae6-48e3-a923-020a040ba50e tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:08:54.807312 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d6fbd8c3-dae6-48e3-a923-020a040ba50e tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:08:54.808078 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d6fbd8c3-dae6-48e3-a923-020a040ba50e tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:08:54.808510 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-d6fbd8c3-dae6-48e3-a923-020a040ba50e tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:08:54.822594 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.wsgi [None req-d6fbd8c3-dae6-48e3-a923-020a040ba50e tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] HTTP exception thrown: Instance 267d974a-0a42-4e11-ada0-68e101c4a48f could not be found. Jul 30 05:08:54.824115 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-d6fbd8c3-dae6-48e3-a923-020a040ba50e tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Request method failure captured: Jul 30 05:08:54.824115 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: request: GET /compute/v2.1/servers/267d974a-0a42-4e11-ada0-68e101c4a48f HTTP/1.1 Jul 30 05:08:54.824115 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Accept: application/json Jul 30 05:08:54.824115 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Accept-Encoding: identity Jul 30 05:08:54.824115 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Connection: close Jul 30 05:08:54.824115 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Content-Length: 0 Jul 30 05:08:54.824115 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Content-Type: application/json Jul 30 05:08:54.824115 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Host: 10.222.0.20 Jul 30 05:08:54.824115 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Openstack-System-Scope: None Jul 30 05:08:54.824115 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: User-Agent: python-urllib3/1.26.10 Jul 30 05:08:54.824115 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Auth-Token: gAAAAABi5LsFP9OEche5y4lXG8VwGjqGB-lqgOtZrs-5_9c2R6Ag-8NJaxcwTtiw3SgdSFybZr7J-RfHRufrRc3qDvPG20s46MHR8DjH4ANvKOo1Trrkozk2BziuELSDEtqCND7Enojbk0EIGZsF5tf92zb61OWPzHEQzgEVzNlSDTTbdyS26ok Jul 30 05:08:54.824115 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Domain-Id: None Jul 30 05:08:54.824115 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Domain-Name: None Jul 30 05:08:54.824115 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Identity-Status: Confirmed Jul 30 05:08:54.824115 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Is-Admin-Project: True Jul 30 05:08:54.824115 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Domain-Id: default Jul 30 05:08:54.824115 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Domain-Name: Default Jul 30 05:08:54.824115 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Id: db365a6a9f6041a7a8749fd1a1e3d488 Jul 30 05:08:54.824115 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Name: tempest-TestVolumeBootPattern-2000315609 Jul 30 05:08:54.824115 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Role: member,reader Jul 30 05:08:54.824115 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Roles: member,reader Jul 30 05:08:54.825736 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/db365a6a9f6041a7a8749fd1a1e3d488"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/db365a6a9f6041a7a8749fd1a1e3d488"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_db365a6a9f6041a7a8749fd1a1e3d488"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/db365a6a9f6041a7a8749fd1a1e3d488"}]}] Jul 30 05:08:54.825736 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Tenant: tempest-TestVolumeBootPattern-2000315609 Jul 30 05:08:54.825736 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Tenant-Id: db365a6a9f6041a7a8749fd1a1e3d488 Jul 30 05:08:54.825736 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Tenant-Name: tempest-TestVolumeBootPattern-2000315609 Jul 30 05:08:54.825736 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User: tempest-TestVolumeBootPattern-2000315609-project Jul 30 05:08:54.825736 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Domain-Id: default Jul 30 05:08:54.825736 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Domain-Name: Default Jul 30 05:08:54.825736 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Id: 407ad282edd74fb1adf62fb63306779c Jul 30 05:08:54.825736 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Name: tempest-TestVolumeBootPattern-2000315609-project Jul 30 05:08:54.825736 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: method: > Jul 30 05:08:54.825736 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: exception: Instance 267d974a-0a42-4e11-ada0-68e101c4a48f could not be found. Jul 30 05:08:54.825736 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: action_args: {'id': '267d974a-0a42-4e11-ada0-68e101c4a48f'} Jul 30 05:08:54.826625 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 05:08:54.826625 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:08:54.826625 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 05:08:54.826625 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 05:08:54.826625 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 05:08:54.826625 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 05:08:54.826625 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 05:08:54.826625 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 05:08:54.826625 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 05:08:54.826625 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 05:08:54.826625 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 267d974a-0a42-4e11-ada0-68e101c4a48f could not be found. Jul 30 05:08:54.826625 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:08:54.826625 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 05:08:54.826625 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:08:54.826625 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:08:54.826625 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 05:08:54.826625 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 05:08:54.826625 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 05:08:54.826625 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 05:08:54.826625 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 05:08:54.827938 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 05:08:54.827938 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 05:08:54.827938 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 05:08:54.827938 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 05:08:54.827938 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 05:08:54.827938 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 05:08:54.827938 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 05:08:54.827938 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 267d974a-0a42-4e11-ada0-68e101c4a48f could not be found. Jul 30 05:08:54.827938 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:08:54.827938 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 05:08:54.827938 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:08:54.827938 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:08:54.827938 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 05:08:54.827938 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 05:08:54.827938 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 05:08:54.827938 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 05:08:54.827938 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 267d974a-0a42-4e11-ada0-68e101c4a48f could not be found. Jul 30 05:08:54.827938 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:08:54.830376 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-d6fbd8c3-dae6-48e3-a923-020a040ba50e tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Returning 404 to user: Instance 267d974a-0a42-4e11-ada0-68e101c4a48f could not be found. {{(pid=117885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 05:08:54.830376 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-d6fbd8c3-dae6-48e3-a923-020a040ba50e tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] 10.222.0.20 "GET /compute/v2.1/servers/267d974a-0a42-4e11-ada0-68e101c4a48f" status: 404 len: 111 microversion: 2.1 time: 0.031047 Jul 30 05:08:54.830376 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 574/1193] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:08:54 2022] GET /compute/v2.1/servers/267d974a-0a42-4e11-ada0-68e101c4a48f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 05:08:55.189236 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-f8e8d81f-eeb1-48a2-9281-15a1abc3a827 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:08:55.189890 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-f8e8d81f-eeb1-48a2-9281-15a1abc3a827 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] [instance: 8fd2f208-dd3d-4ea2-b97f-5c70404be701] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:08:55.195947 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f8e8d81f-eeb1-48a2-9281-15a1abc3a827 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:08:55.196402 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f8e8d81f-eeb1-48a2-9281-15a1abc3a827 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:08:55.197170 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f8e8d81f-eeb1-48a2-9281-15a1abc3a827 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:08:55.197614 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f8e8d81f-eeb1-48a2-9281-15a1abc3a827 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:08:55.330055 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-f8e8d81f-eeb1-48a2-9281-15a1abc3a827 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a805f5dec66484c8d950b6bc52e3e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f8c70dc5de488698a8ab775c618088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:08:55.337587 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-f8e8d81f-eeb1-48a2-9281-15a1abc3a827 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] 10.222.0.20 "GET /compute/v2.1/servers/8fd2f208-dd3d-4ea2-b97f-5c70404be701" status: 200 len: 1548 microversion: 2.1 time: 0.152157 Jul 30 05:08:55.338184 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 620/1194] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:08:55 2022] GET /compute/v2.1/servers/8fd2f208-dd3d-4ea2-b97f-5c70404be701 => generated 1548 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:08:55.359553 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-8157ac62-aa4b-46e4-aa17-465d93f503ce tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:08:55.360222 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-8157ac62-aa4b-46e4-aa17-465d93f503ce tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] [instance: 8fd2f208-dd3d-4ea2-b97f-5c70404be701] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:08:55.366679 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8157ac62-aa4b-46e4-aa17-465d93f503ce tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:08:55.367131 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8157ac62-aa4b-46e4-aa17-465d93f503ce tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:08:55.367889 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8157ac62-aa4b-46e4-aa17-465d93f503ce tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:08:55.368347 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8157ac62-aa4b-46e4-aa17-465d93f503ce tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:08:55.445665 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-8157ac62-aa4b-46e4-aa17-465d93f503ce tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] 10.222.0.20 "GET /compute/v2.1/servers/8fd2f208-dd3d-4ea2-b97f-5c70404be701/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090057 Jul 30 05:08:55.446257 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 575/1195] 10.222.0.20 () {58 vars in 1275 bytes} [Sat Jul 30 05:08:55 2022] GET /compute/v2.1/servers/8fd2f208-dd3d-4ea2-b97f-5c70404be701/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 05:08:56.129135 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-e9cd4b1a-8162-417d-a25e-622e27b0490d tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] Calling method '.version_select at 0x7f2db401b9d0>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:08:56.133926 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell0:SELECT=2 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:08:56.134909 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell0:SELECT=6 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:08:56.155435 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-e9cd4b1a-8162-417d-a25e-622e27b0490d tempest-TestVolumeBootPattern-2000315609 tempest-TestVolumeBootPattern-2000315609-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-275234029" status: 202 len: 0 microversion: 2.1 time: 0.030282 Jul 30 05:08:56.157187 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 621/1196] 10.222.0.20 () {58 vars in 1260 bytes} [Sat Jul 30 05:08:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-275234029 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 05:08:56.410367 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [req-e63de6c7-4313-4148-9c9c-2dff0a196c52 req-ec71d570-0288-4ce0-a1d1-173d621f8c23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8fd2f208-dd3d-4ea2-b97f-5c70404be701", "tag": "ac0f2638-da55-4a28-919f-b194d81ff725"}]} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:08:56.416128 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell0:SELECT=6 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:08:56.423165 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-e63de6c7-4313-4148-9c9c-2dff0a196c52 req-ec71d570-0288-4ce0-a1d1-173d621f8c23 service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:08:56.423837 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [req-e63de6c7-4313-4148-9c9c-2dff0a196c52 req-ec71d570-0288-4ce0-a1d1-173d621f8c23 service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:08:56.437090 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.compute.server_external_events [req-e63de6c7-4313-4148-9c9c-2dff0a196c52 req-ec71d570-0288-4ce0-a1d1-173d621f8c23 service nova] Creating event network-changed:ac0f2638-da55-4a28-919f-b194d81ff725 for instance 8fd2f208-dd3d-4ea2-b97f-5c70404be701 on hv-cinder-85127 Jul 30 05:08:56.443153 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [req-e63de6c7-4313-4148-9c9c-2dff0a196c52 req-ec71d570-0288-4ce0-a1d1-173d621f8c23 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036325 Jul 30 05:08:56.443688 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 576/1197] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Jul 30 05:08:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 05:09:29.298247 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_cell1:SELECT=12 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:09:29.299073 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG dbcounter [-] [117886] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=3,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=117886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:09:29.303034 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-d9777681-eb04-4e47-9f64-d2e132fe8cf7 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:09:29.303535 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-d9777681-eb04-4e47-9f64-d2e132fe8cf7 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] [instance: 8fd2f208-dd3d-4ea2-b97f-5c70404be701] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:09:29.310513 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d9777681-eb04-4e47-9f64-d2e132fe8cf7 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:09:29.310972 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d9777681-eb04-4e47-9f64-d2e132fe8cf7 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:09:29.311743 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d9777681-eb04-4e47-9f64-d2e132fe8cf7 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:09:29.312240 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-d9777681-eb04-4e47-9f64-d2e132fe8cf7 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:09:29.338769 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-d9777681-eb04-4e47-9f64-d2e132fe8cf7 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] 10.222.0.20 "GET /compute/v2.1/servers/8fd2f208-dd3d-4ea2-b97f-5c70404be701/ips" status: 200 len: 144 microversion: 2.1 time: 0.042561 Jul 30 05:09:29.339325 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 622/1198] 10.222.0.20 () {58 vars in 1248 bytes} [Sat Jul 30 05:09:29 2022] GET /compute/v2.1/servers/8fd2f208-dd3d-4ea2-b97f-5c70404be701/ips => generated 144 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 05:09:30.659610 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=1 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:09:30.660406 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG dbcounter [-] [117885] Writing DB stats nova_cell1:SELECT=78 {{(pid=117885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 30 05:09:30.664639 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-32ff9979-1f0b-4bfa-8fd8-0de3521737b0 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ebf529d8-4344-4130-a984-e8204890f133"}} {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:09:30.667331 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-32ff9979-1f0b-4bfa-8fd8-0de3521737b0 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] [instance: 8fd2f208-dd3d-4ea2-b97f-5c70404be701] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:09:30.675042 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-32ff9979-1f0b-4bfa-8fd8-0de3521737b0 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:09:30.675503 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-32ff9979-1f0b-4bfa-8fd8-0de3521737b0 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:09:30.676280 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-32ff9979-1f0b-4bfa-8fd8-0de3521737b0 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:09:30.676725 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-32ff9979-1f0b-4bfa-8fd8-0de3521737b0 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:09:30.909743 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-32ff9979-1f0b-4bfa-8fd8-0de3521737b0 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] 10.222.0.20 "POST /compute/v2.1/servers/8fd2f208-dd3d-4ea2-b97f-5c70404be701/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.251572 Jul 30 05:09:30.910421 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 577/1199] 10.222.0.20 () {60 vars in 1323 bytes} [Sat Jul 30 05:09:30 2022] POST /compute/v2.1/servers/8fd2f208-dd3d-4ea2-b97f-5c70404be701/os-volume_attachments => generated 194 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 05:09:37.376878 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-a4851984-5163-49ce-a576-ae0b850dbf8f tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:09:37.379076 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-a4851984-5163-49ce-a576-ae0b850dbf8f tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] [instance: 8fd2f208-dd3d-4ea2-b97f-5c70404be701] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:09:37.385084 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a4851984-5163-49ce-a576-ae0b850dbf8f tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:09:37.385540 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a4851984-5163-49ce-a576-ae0b850dbf8f tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:09:37.386306 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a4851984-5163-49ce-a576-ae0b850dbf8f tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:09:37.386792 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-a4851984-5163-49ce-a576-ae0b850dbf8f tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:09:37.417349 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-a4851984-5163-49ce-a576-ae0b850dbf8f tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] 10.222.0.20 "GET /compute/v2.1/servers/8fd2f208-dd3d-4ea2-b97f-5c70404be701/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044505 Jul 30 05:09:37.417943 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 623/1200] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Jul 30 05:09:37 2022] GET /compute/v2.1/servers/8fd2f208-dd3d-4ea2-b97f-5c70404be701/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 05:09:37.429788 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-0f1adba4-ac35-4995-9300-0614896c860a tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:09:37.430665 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-0f1adba4-ac35-4995-9300-0614896c860a tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] [instance: 8fd2f208-dd3d-4ea2-b97f-5c70404be701] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:09:37.436609 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0f1adba4-ac35-4995-9300-0614896c860a tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:09:37.437059 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0f1adba4-ac35-4995-9300-0614896c860a tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:09:37.437811 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0f1adba4-ac35-4995-9300-0614896c860a tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:09:37.438252 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-0f1adba4-ac35-4995-9300-0614896c860a tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:09:37.465940 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-0f1adba4-ac35-4995-9300-0614896c860a tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] 10.222.0.20 "GET /compute/v2.1/servers/8fd2f208-dd3d-4ea2-b97f-5c70404be701/os-volume_attachments/ebf529d8-4344-4130-a984-e8204890f133" status: 200 len: 194 microversion: 2.1 time: 0.040922 Jul 30 05:09:37.466528 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 578/1201] 10.222.0.20 () {58 vars in 1413 bytes} [Sat Jul 30 05:09:37 2022] GET /compute/v2.1/servers/8fd2f208-dd3d-4ea2-b97f-5c70404be701/os-volume_attachments/ebf529d8-4344-4130-a984-e8204890f133 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 05:09:38.813560 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-e43589b9-8ab2-42f5-90b7-18ee0af40190 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fc59e05c-955f-48d0-adc6-b27e32f63b6a"}} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:09:38.815893 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-e43589b9-8ab2-42f5-90b7-18ee0af40190 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] [instance: 8fd2f208-dd3d-4ea2-b97f-5c70404be701] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:09:38.822303 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e43589b9-8ab2-42f5-90b7-18ee0af40190 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:09:38.822793 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e43589b9-8ab2-42f5-90b7-18ee0af40190 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:09:38.823557 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e43589b9-8ab2-42f5-90b7-18ee0af40190 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:09:38.823998 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-e43589b9-8ab2-42f5-90b7-18ee0af40190 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:09:39.059150 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-e43589b9-8ab2-42f5-90b7-18ee0af40190 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] 10.222.0.20 "POST /compute/v2.1/servers/8fd2f208-dd3d-4ea2-b97f-5c70404be701/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.250276 Jul 30 05:09:39.059791 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 624/1202] 10.222.0.20 () {60 vars in 1323 bytes} [Sat Jul 30 05:09:38 2022] POST /compute/v2.1/servers/8fd2f208-dd3d-4ea2-b97f-5c70404be701/os-volume_attachments => generated 194 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 05:09:45.526470 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-7fac9fd1-1f01-426f-a8cc-381c971146a8 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:09:45.528602 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-7fac9fd1-1f01-426f-a8cc-381c971146a8 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] [instance: 8fd2f208-dd3d-4ea2-b97f-5c70404be701] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:09:45.535689 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7fac9fd1-1f01-426f-a8cc-381c971146a8 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:09:45.536135 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7fac9fd1-1f01-426f-a8cc-381c971146a8 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:09:45.536921 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7fac9fd1-1f01-426f-a8cc-381c971146a8 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:09:45.537360 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-7fac9fd1-1f01-426f-a8cc-381c971146a8 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:09:45.567301 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-7fac9fd1-1f01-426f-a8cc-381c971146a8 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] 10.222.0.20 "GET /compute/v2.1/servers/8fd2f208-dd3d-4ea2-b97f-5c70404be701/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044662 Jul 30 05:09:45.567771 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 579/1203] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Jul 30 05:09:45 2022] GET /compute/v2.1/servers/8fd2f208-dd3d-4ea2-b97f-5c70404be701/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 05:09:45.710883 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-43490043-2745-42b6-be48-8d9ac573feca tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:09:45.711491 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-43490043-2745-42b6-be48-8d9ac573feca tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] [instance: 8fd2f208-dd3d-4ea2-b97f-5c70404be701] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:09:45.718230 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-43490043-2745-42b6-be48-8d9ac573feca tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:09:45.718720 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-43490043-2745-42b6-be48-8d9ac573feca tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:09:45.719489 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-43490043-2745-42b6-be48-8d9ac573feca tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:09:45.719927 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-43490043-2745-42b6-be48-8d9ac573feca tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:09:45.747982 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-43490043-2745-42b6-be48-8d9ac573feca tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] 10.222.0.20 "GET /compute/v2.1/servers/8fd2f208-dd3d-4ea2-b97f-5c70404be701/os-volume_attachments/ebf529d8-4344-4130-a984-e8204890f133" status: 200 len: 194 microversion: 2.1 time: 0.042145 Jul 30 05:09:45.749695 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 625/1204] 10.222.0.20 () {58 vars in 1413 bytes} [Sat Jul 30 05:09:45 2022] GET /compute/v2.1/servers/8fd2f208-dd3d-4ea2-b97f-5c70404be701/os-volume_attachments/ebf529d8-4344-4130-a984-e8204890f133 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 05:09:45.759972 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-834c2a63-caee-4d97-b6c4-a8b6de26c301 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:09:45.760493 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-834c2a63-caee-4d97-b6c4-a8b6de26c301 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] [instance: 8fd2f208-dd3d-4ea2-b97f-5c70404be701] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:09:45.766731 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-834c2a63-caee-4d97-b6c4-a8b6de26c301 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:09:45.767181 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-834c2a63-caee-4d97-b6c4-a8b6de26c301 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:09:45.767931 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-834c2a63-caee-4d97-b6c4-a8b6de26c301 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:09:45.768360 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-834c2a63-caee-4d97-b6c4-a8b6de26c301 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:09:45.852030 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.objects.instance [None req-834c2a63-caee-4d97-b6c4-a8b6de26c301 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lazy-loading 'services' on Instance uuid 8fd2f208-dd3d-4ea2-b97f-5c70404be701 {{(pid=117885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 05:09:45.927057 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-834c2a63-caee-4d97-b6c4-a8b6de26c301 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8fd2f208-dd3d-4ea2-b97f-5c70404be701/os-volume_attachments/ebf529d8-4344-4130-a984-e8204890f133" status: 202 len: 0 microversion: 2.1 time: 0.170800 Jul 30 05:09:45.927678 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 580/1205] 10.222.0.20 () {58 vars in 1416 bytes} [Sat Jul 30 05:09:45 2022] DELETE /compute/v2.1/servers/8fd2f208-dd3d-4ea2-b97f-5c70404be701/os-volume_attachments/ebf529d8-4344-4130-a984-e8204890f133 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 05:09:47.047006 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-63effab3-5463-443a-ada9-e28ab32ff9f5 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:09:47.047490 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-63effab3-5463-443a-ada9-e28ab32ff9f5 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] [instance: 8fd2f208-dd3d-4ea2-b97f-5c70404be701] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:09:47.054003 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-63effab3-5463-443a-ada9-e28ab32ff9f5 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:09:47.054490 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-63effab3-5463-443a-ada9-e28ab32ff9f5 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:09:47.055271 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-63effab3-5463-443a-ada9-e28ab32ff9f5 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:09:47.055711 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-63effab3-5463-443a-ada9-e28ab32ff9f5 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:09:47.084352 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-63effab3-5463-443a-ada9-e28ab32ff9f5 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] 10.222.0.20 "GET /compute/v2.1/servers/8fd2f208-dd3d-4ea2-b97f-5c70404be701/os-volume_attachments/fc59e05c-955f-48d0-adc6-b27e32f63b6a" status: 200 len: 194 microversion: 2.1 time: 0.041327 Jul 30 05:09:47.084961 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 626/1206] 10.222.0.20 () {58 vars in 1413 bytes} [Sat Jul 30 05:09:47 2022] GET /compute/v2.1/servers/8fd2f208-dd3d-4ea2-b97f-5c70404be701/os-volume_attachments/fc59e05c-955f-48d0-adc6-b27e32f63b6a => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 05:09:47.096821 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-e0a17769-0b6f-4ba1-892c-61b8f44e2987 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:09:47.097402 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-e0a17769-0b6f-4ba1-892c-61b8f44e2987 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] [instance: 8fd2f208-dd3d-4ea2-b97f-5c70404be701] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:09:47.103557 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e0a17769-0b6f-4ba1-892c-61b8f44e2987 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:09:47.104020 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e0a17769-0b6f-4ba1-892c-61b8f44e2987 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:09:47.104778 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e0a17769-0b6f-4ba1-892c-61b8f44e2987 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:09:47.105218 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-e0a17769-0b6f-4ba1-892c-61b8f44e2987 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:09:47.183748 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.objects.instance [None req-e0a17769-0b6f-4ba1-892c-61b8f44e2987 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lazy-loading 'services' on Instance uuid 8fd2f208-dd3d-4ea2-b97f-5c70404be701 {{(pid=117885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 30 05:09:47.252184 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-e0a17769-0b6f-4ba1-892c-61b8f44e2987 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8fd2f208-dd3d-4ea2-b97f-5c70404be701/os-volume_attachments/fc59e05c-955f-48d0-adc6-b27e32f63b6a" status: 202 len: 0 microversion: 2.1 time: 0.160555 Jul 30 05:09:47.252703 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 581/1207] 10.222.0.20 () {58 vars in 1416 bytes} [Sat Jul 30 05:09:47 2022] DELETE /compute/v2.1/servers/8fd2f208-dd3d-4ea2-b97f-5c70404be701/os-volume_attachments/fc59e05c-955f-48d0-adc6-b27e32f63b6a => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 05:09:48.595573 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-f3553353-4b7a-4e92-94d6-b586c9c8109a tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:09:48.597808 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-f3553353-4b7a-4e92-94d6-b586c9c8109a tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] [instance: 8fd2f208-dd3d-4ea2-b97f-5c70404be701] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:09:48.604263 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f3553353-4b7a-4e92-94d6-b586c9c8109a tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:09:48.604716 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f3553353-4b7a-4e92-94d6-b586c9c8109a tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:09:48.605481 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f3553353-4b7a-4e92-94d6-b586c9c8109a tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:09:48.605918 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-f3553353-4b7a-4e92-94d6-b586c9c8109a tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:09:48.635069 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-f3553353-4b7a-4e92-94d6-b586c9c8109a tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] 10.222.0.20 "GET /compute/v2.1/servers/8fd2f208-dd3d-4ea2-b97f-5c70404be701/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043854 Jul 30 05:09:48.635616 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 627/1208] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Jul 30 05:09:48 2022] GET /compute/v2.1/servers/8fd2f208-dd3d-4ea2-b97f-5c70404be701/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 30 05:09:48.749037 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-dd1a338e-7013-4fbf-878d-28e7491e3eb3 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:09:48.751390 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-dd1a338e-7013-4fbf-878d-28e7491e3eb3 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] [instance: 8fd2f208-dd3d-4ea2-b97f-5c70404be701] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:09:48.757548 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-dd1a338e-7013-4fbf-878d-28e7491e3eb3 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:09:48.758004 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-dd1a338e-7013-4fbf-878d-28e7491e3eb3 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:09:48.758807 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-dd1a338e-7013-4fbf-878d-28e7491e3eb3 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:09:48.759258 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-dd1a338e-7013-4fbf-878d-28e7491e3eb3 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:09:48.788925 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-dd1a338e-7013-4fbf-878d-28e7491e3eb3 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] 10.222.0.20 "GET /compute/v2.1/servers/8fd2f208-dd3d-4ea2-b97f-5c70404be701/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044890 Jul 30 05:09:48.789752 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 582/1209] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Jul 30 05:09:48 2022] GET /compute/v2.1/servers/8fd2f208-dd3d-4ea2-b97f-5c70404be701/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 30 05:09:48.850177 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-44598fe8-6a00-4676-94bc-d324aa23142f tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:09:48.850703 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-44598fe8-6a00-4676-94bc-d324aa23142f tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] [instance: 8fd2f208-dd3d-4ea2-b97f-5c70404be701] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:09:48.856625 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-44598fe8-6a00-4676-94bc-d324aa23142f tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:09:48.857072 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-44598fe8-6a00-4676-94bc-d324aa23142f tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:09:48.857852 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-44598fe8-6a00-4676-94bc-d324aa23142f tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:09:48.858398 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-44598fe8-6a00-4676-94bc-d324aa23142f tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:09:48.883535 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-44598fe8-6a00-4676-94bc-d324aa23142f tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] [instance: 8fd2f208-dd3d-4ea2-b97f-5c70404be701] Going to try to terminate instance {{(pid=117886) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 30 05:09:48.957349 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-44598fe8-6a00-4676-94bc-d324aa23142f tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8fd2f208-dd3d-4ea2-b97f-5c70404be701" status: 204 len: 0 microversion: 2.1 time: 0.110746 Jul 30 05:09:48.957933 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 628/1210] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Jul 30 05:09:48 2022] DELETE /compute/v2.1/servers/8fd2f208-dd3d-4ea2-b97f-5c70404be701 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 30 05:09:48.966666 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-2cc07173-ab7b-4532-9d80-ca06eb8f6bfa tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:09:48.967549 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-2cc07173-ab7b-4532-9d80-ca06eb8f6bfa tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] [instance: 8fd2f208-dd3d-4ea2-b97f-5c70404be701] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:09:48.973437 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2cc07173-ab7b-4532-9d80-ca06eb8f6bfa tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:09:48.973886 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2cc07173-ab7b-4532-9d80-ca06eb8f6bfa tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:09:48.974667 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2cc07173-ab7b-4532-9d80-ca06eb8f6bfa tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:09:48.975102 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-2cc07173-ab7b-4532-9d80-ca06eb8f6bfa tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:09:49.105204 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-2cc07173-ab7b-4532-9d80-ca06eb8f6bfa tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a805f5dec66484c8d950b6bc52e3e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f8c70dc5de488698a8ab775c618088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:09:49.112931 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-2cc07173-ab7b-4532-9d80-ca06eb8f6bfa tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] 10.222.0.20 "GET /compute/v2.1/servers/8fd2f208-dd3d-4ea2-b97f-5c70404be701" status: 200 len: 1672 microversion: 2.1 time: 0.150593 Jul 30 05:09:49.113505 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 583/1211] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:09:48 2022] GET /compute/v2.1/servers/8fd2f208-dd3d-4ea2-b97f-5c70404be701 => generated 1672 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:09:50.135430 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-71c50370-00cb-4d39-9aaf-a8d007169766 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:09:50.136139 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-71c50370-00cb-4d39-9aaf-a8d007169766 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] [instance: 8fd2f208-dd3d-4ea2-b97f-5c70404be701] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:09:50.143050 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-71c50370-00cb-4d39-9aaf-a8d007169766 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:09:50.143502 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-71c50370-00cb-4d39-9aaf-a8d007169766 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:09:50.144275 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-71c50370-00cb-4d39-9aaf-a8d007169766 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:09:50.144717 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-71c50370-00cb-4d39-9aaf-a8d007169766 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:09:50.281741 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.policy [None req-71c50370-00cb-4d39-9aaf-a8d007169766 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a805f5dec66484c8d950b6bc52e3e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f8c70dc5de488698a8ab775c618088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:09:50.289458 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-71c50370-00cb-4d39-9aaf-a8d007169766 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] 10.222.0.20 "GET /compute/v2.1/servers/8fd2f208-dd3d-4ea2-b97f-5c70404be701" status: 200 len: 1672 microversion: 2.1 time: 0.157974 Jul 30 05:09:50.290021 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 629/1212] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:09:50 2022] GET /compute/v2.1/servers/8fd2f208-dd3d-4ea2-b97f-5c70404be701 => generated 1672 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 30 05:09:51.311555 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-a336b8f1-f750-43a5-96d6-053eaed2c490 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:09:51.313043 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-a336b8f1-f750-43a5-96d6-053eaed2c490 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] [instance: 8fd2f208-dd3d-4ea2-b97f-5c70404be701] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:09:51.319580 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a336b8f1-f750-43a5-96d6-053eaed2c490 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:09:51.320031 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a336b8f1-f750-43a5-96d6-053eaed2c490 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:09:51.320802 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a336b8f1-f750-43a5-96d6-053eaed2c490 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:09:51.321263 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-a336b8f1-f750-43a5-96d6-053eaed2c490 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:09:51.387493 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.policy [None req-a336b8f1-f750-43a5-96d6-053eaed2c490 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a805f5dec66484c8d950b6bc52e3e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f8c70dc5de488698a8ab775c618088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 30 05:09:51.395761 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-a336b8f1-f750-43a5-96d6-053eaed2c490 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] 10.222.0.20 "GET /compute/v2.1/servers/8fd2f208-dd3d-4ea2-b97f-5c70404be701" status: 200 len: 1604 microversion: 2.1 time: 0.087652 Jul 30 05:09:51.396355 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 584/1213] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:09:51 2022] GET /compute/v2.1/servers/8fd2f208-dd3d-4ea2-b97f-5c70404be701 => generated 1604 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 30 05:09:51.455213 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [req-627d66f6-c8ad-4310-8e4b-1e1e7873464c req-352c06b4-a278-463a-a110-2589896a14f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fd2f208-dd3d-4ea2-b97f-5c70404be701", "name": "network-vif-deleted", "tag": "ac0f2638-da55-4a28-919f-b194d81ff725"}]} {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 30 05:09:51.467121 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-627d66f6-c8ad-4310-8e4b-1e1e7873464c req-352c06b4-a278-463a-a110-2589896a14f9 service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:09:51.467668 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [req-627d66f6-c8ad-4310-8e4b-1e1e7873464c req-352c06b4-a278-463a-a110-2589896a14f9 service nova] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:09:51.482242 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.compute.server_external_events [req-627d66f6-c8ad-4310-8e4b-1e1e7873464c req-352c06b4-a278-463a-a110-2589896a14f9 service nova] Creating event network-vif-deleted:ac0f2638-da55-4a28-919f-b194d81ff725 for instance 8fd2f208-dd3d-4ea2-b97f-5c70404be701 on hv-cinder-85127 Jul 30 05:09:51.488680 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [req-627d66f6-c8ad-4310-8e4b-1e1e7873464c req-352c06b4-a278-463a-a110-2589896a14f9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038315 Jul 30 05:09:51.491238 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 630/1214] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Jul 30 05:09:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 30 05:09:52.417336 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-5215d569-8bf5-486b-9a3a-05366fa003d0 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:09:52.417950 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-5215d569-8bf5-486b-9a3a-05366fa003d0 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] [instance: 8fd2f208-dd3d-4ea2-b97f-5c70404be701] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:09:52.425201 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5215d569-8bf5-486b-9a3a-05366fa003d0 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:09:52.425647 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5215d569-8bf5-486b-9a3a-05366fa003d0 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:09:52.426415 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5215d569-8bf5-486b-9a3a-05366fa003d0 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:09:52.426903 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-5215d569-8bf5-486b-9a3a-05366fa003d0 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:09:52.440448 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.wsgi [None req-5215d569-8bf5-486b-9a3a-05366fa003d0 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] HTTP exception thrown: Instance 8fd2f208-dd3d-4ea2-b97f-5c70404be701 could not be found. Jul 30 05:09:52.442082 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-5215d569-8bf5-486b-9a3a-05366fa003d0 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Request method failure captured: Jul 30 05:09:52.442082 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: request: GET /compute/v2.1/servers/8fd2f208-dd3d-4ea2-b97f-5c70404be701 HTTP/1.1 Jul 30 05:09:52.442082 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Accept: application/json Jul 30 05:09:52.442082 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Accept-Encoding: identity Jul 30 05:09:52.442082 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Connection: close Jul 30 05:09:52.442082 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Content-Length: 0 Jul 30 05:09:52.442082 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Content-Type: application/json Jul 30 05:09:52.442082 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Host: 10.222.0.20 Jul 30 05:09:52.442082 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Openstack-System-Scope: None Jul 30 05:09:52.442082 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: User-Agent: python-urllib3/1.26.10 Jul 30 05:09:52.442082 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Auth-Token: gAAAAABi5Lwx6u3dW8NgrhXRDeFXnnP4lKZIRtv95bi5xMIG9sQWzxvNRse6IwUXHzfxnT7jfXw1pF1w6rwEHJ09LzDtMWM5u0sWuNEZ6hZdfnFHX8MrtI_AUV39i3jn62Xa0Oa4hMKssKbQMxnqU81KKd6CEuwP8myCBr3mKHN0Nm_CGgcZN90 Jul 30 05:09:52.442082 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Domain-Id: None Jul 30 05:09:52.442082 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Domain-Name: None Jul 30 05:09:52.442082 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Identity-Status: Confirmed Jul 30 05:09:52.442082 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Is-Admin-Project: True Jul 30 05:09:52.442082 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Domain-Id: default Jul 30 05:09:52.442082 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Domain-Name: Default Jul 30 05:09:52.442082 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Id: d9f8c70dc5de488698a8ab775c618088 Jul 30 05:09:52.442082 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Name: tempest-AttachVolumeTestJSON-1448876773 Jul 30 05:09:52.442082 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Role: member,reader Jul 30 05:09:52.442082 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Roles: member,reader Jul 30 05:09:52.443811 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d9f8c70dc5de488698a8ab775c618088"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d9f8c70dc5de488698a8ab775c618088"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d9f8c70dc5de488698a8ab775c618088"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d9f8c70dc5de488698a8ab775c618088"}]}] Jul 30 05:09:52.443811 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Tenant: tempest-AttachVolumeTestJSON-1448876773 Jul 30 05:09:52.443811 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Tenant-Id: d9f8c70dc5de488698a8ab775c618088 Jul 30 05:09:52.443811 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1448876773 Jul 30 05:09:52.443811 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User: tempest-AttachVolumeTestJSON-1448876773-project Jul 30 05:09:52.443811 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Domain-Id: default Jul 30 05:09:52.443811 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Domain-Name: Default Jul 30 05:09:52.443811 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Id: 3a805f5dec66484c8d950b6bc52e3e03 Jul 30 05:09:52.443811 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Name: tempest-AttachVolumeTestJSON-1448876773-project Jul 30 05:09:52.443811 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: method: > Jul 30 05:09:52.443811 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: exception: Instance 8fd2f208-dd3d-4ea2-b97f-5c70404be701 could not be found. Jul 30 05:09:52.443811 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: action_args: {'id': '8fd2f208-dd3d-4ea2-b97f-5c70404be701'} Jul 30 05:09:52.444710 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 05:09:52.444710 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:09:52.444710 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 05:09:52.444710 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 05:09:52.444710 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 05:09:52.444710 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 05:09:52.444710 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 05:09:52.444710 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 05:09:52.444710 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 05:09:52.444710 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 05:09:52.444710 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fd2f208-dd3d-4ea2-b97f-5c70404be701 could not be found. Jul 30 05:09:52.444710 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:09:52.444710 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 05:09:52.444710 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:09:52.444710 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:09:52.444710 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 05:09:52.444710 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 05:09:52.444710 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 05:09:52.444710 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 05:09:52.444710 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 05:09:52.446300 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 05:09:52.446300 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 05:09:52.446300 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 05:09:52.446300 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 05:09:52.446300 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 05:09:52.446300 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 05:09:52.446300 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 05:09:52.446300 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fd2f208-dd3d-4ea2-b97f-5c70404be701 could not be found. Jul 30 05:09:52.446300 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:09:52.446300 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 05:09:52.446300 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:09:52.446300 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:09:52.446300 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 05:09:52.446300 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 05:09:52.446300 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 05:09:52.446300 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 05:09:52.446300 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fd2f208-dd3d-4ea2-b97f-5c70404be701 could not be found. Jul 30 05:09:52.446300 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:09:52.447688 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-5215d569-8bf5-486b-9a3a-05366fa003d0 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Returning 404 to user: Instance 8fd2f208-dd3d-4ea2-b97f-5c70404be701 could not be found. {{(pid=117885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 05:09:52.447688 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-5215d569-8bf5-486b-9a3a-05366fa003d0 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] 10.222.0.20 "GET /compute/v2.1/servers/8fd2f208-dd3d-4ea2-b97f-5c70404be701" status: 404 len: 111 microversion: 2.1 time: 0.030321 Jul 30 05:09:52.447688 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 585/1215] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:09:52 2022] GET /compute/v2.1/servers/8fd2f208-dd3d-4ea2-b97f-5c70404be701 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 05:09:52.453012 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-1938728e-7947-4935-bfa5-1d1296d2e625 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Calling method '.version_select at 0x7f2db40e3790>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:09:52.471990 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-1938728e-7947-4935-bfa5-1d1296d2e625 tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-844669600" status: 202 len: 0 microversion: 2.1 time: 0.023231 Jul 30 05:09:52.472583 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 631/1216] 10.222.0.20 () {58 vars in 1218 bytes} [Sat Jul 30 05:09:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-844669600 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 30 05:09:55.354731 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-b37ec1eb-198e-439c-b140-1f42c7d2813a tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:09:55.355241 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-b37ec1eb-198e-439c-b140-1f42c7d2813a tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] [instance: 8fd2f208-dd3d-4ea2-b97f-5c70404be701] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:09:55.362378 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b37ec1eb-198e-439c-b140-1f42c7d2813a tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:09:55.362866 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b37ec1eb-198e-439c-b140-1f42c7d2813a tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:09:55.363638 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b37ec1eb-198e-439c-b140-1f42c7d2813a tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:09:55.364082 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-b37ec1eb-198e-439c-b140-1f42c7d2813a tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:09:55.377416 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.wsgi [None req-b37ec1eb-198e-439c-b140-1f42c7d2813a tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] HTTP exception thrown: Instance 8fd2f208-dd3d-4ea2-b97f-5c70404be701 could not be found. Jul 30 05:09:55.378981 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-b37ec1eb-198e-439c-b140-1f42c7d2813a tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Request method failure captured: Jul 30 05:09:55.378981 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: request: DELETE /compute/v2.1/servers/8fd2f208-dd3d-4ea2-b97f-5c70404be701 HTTP/1.1 Jul 30 05:09:55.378981 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Accept: application/json Jul 30 05:09:55.378981 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Accept-Encoding: identity Jul 30 05:09:55.378981 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Connection: close Jul 30 05:09:55.378981 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Content-Length: 0 Jul 30 05:09:55.378981 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Content-Type: application/json Jul 30 05:09:55.378981 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Host: 10.222.0.20 Jul 30 05:09:55.378981 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Openstack-System-Scope: None Jul 30 05:09:55.378981 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: User-Agent: python-urllib3/1.26.10 Jul 30 05:09:55.378981 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Auth-Token: gAAAAABi5Lwx6u3dW8NgrhXRDeFXnnP4lKZIRtv95bi5xMIG9sQWzxvNRse6IwUXHzfxnT7jfXw1pF1w6rwEHJ09LzDtMWM5u0sWuNEZ6hZdfnFHX8MrtI_AUV39i3jn62Xa0Oa4hMKssKbQMxnqU81KKd6CEuwP8myCBr3mKHN0Nm_CGgcZN90 Jul 30 05:09:55.378981 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Domain-Id: None Jul 30 05:09:55.378981 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Domain-Name: None Jul 30 05:09:55.378981 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Identity-Status: Confirmed Jul 30 05:09:55.378981 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Is-Admin-Project: True Jul 30 05:09:55.378981 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Domain-Id: default Jul 30 05:09:55.378981 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Domain-Name: Default Jul 30 05:09:55.378981 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Id: d9f8c70dc5de488698a8ab775c618088 Jul 30 05:09:55.378981 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Name: tempest-AttachVolumeTestJSON-1448876773 Jul 30 05:09:55.378981 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Role: member,reader Jul 30 05:09:55.378981 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Roles: member,reader Jul 30 05:09:55.380600 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d9f8c70dc5de488698a8ab775c618088"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d9f8c70dc5de488698a8ab775c618088"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d9f8c70dc5de488698a8ab775c618088"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d9f8c70dc5de488698a8ab775c618088"}]}] Jul 30 05:09:55.380600 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Tenant: tempest-AttachVolumeTestJSON-1448876773 Jul 30 05:09:55.380600 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Tenant-Id: d9f8c70dc5de488698a8ab775c618088 Jul 30 05:09:55.380600 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1448876773 Jul 30 05:09:55.380600 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User: tempest-AttachVolumeTestJSON-1448876773-project Jul 30 05:09:55.380600 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Domain-Id: default Jul 30 05:09:55.380600 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Domain-Name: Default Jul 30 05:09:55.380600 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Id: 3a805f5dec66484c8d950b6bc52e3e03 Jul 30 05:09:55.380600 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Name: tempest-AttachVolumeTestJSON-1448876773-project Jul 30 05:09:55.380600 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: method: > Jul 30 05:09:55.380600 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: exception: Instance 8fd2f208-dd3d-4ea2-b97f-5c70404be701 could not be found. Jul 30 05:09:55.380600 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: action_args: {'id': '8fd2f208-dd3d-4ea2-b97f-5c70404be701'} Jul 30 05:09:55.381734 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 05:09:55.381734 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:09:55.381734 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 05:09:55.381734 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 05:09:55.381734 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 05:09:55.381734 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 05:09:55.381734 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 05:09:55.381734 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 05:09:55.381734 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 05:09:55.381734 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 05:09:55.381734 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fd2f208-dd3d-4ea2-b97f-5c70404be701 could not be found. Jul 30 05:09:55.381734 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:09:55.381734 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 05:09:55.381734 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:09:55.381734 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:09:55.381734 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 05:09:55.381734 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 05:09:55.381734 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 05:09:55.381734 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 05:09:55.381734 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 05:09:55.383303 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 05:09:55.383303 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 30 05:09:55.383303 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 30 05:09:55.383303 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 30 05:09:55.383303 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 30 05:09:55.383303 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 05:09:55.383303 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 05:09:55.383303 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 05:09:55.383303 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 05:09:55.383303 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fd2f208-dd3d-4ea2-b97f-5c70404be701 could not be found. Jul 30 05:09:55.383303 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:09:55.383303 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 05:09:55.383303 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:09:55.383303 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:09:55.383303 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 05:09:55.383303 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 05:09:55.383303 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 05:09:55.383303 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 05:09:55.383303 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fd2f208-dd3d-4ea2-b97f-5c70404be701 could not be found. Jul 30 05:09:55.383303 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:09:55.384807 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-b37ec1eb-198e-439c-b140-1f42c7d2813a tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Returning 404 to user: Instance 8fd2f208-dd3d-4ea2-b97f-5c70404be701 could not be found. {{(pid=117885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 05:09:55.384807 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-b37ec1eb-198e-439c-b140-1f42c7d2813a tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8fd2f208-dd3d-4ea2-b97f-5c70404be701" status: 404 len: 111 microversion: 2.1 time: 0.029531 Jul 30 05:09:55.384807 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 586/1217] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Jul 30 05:09:55 2022] DELETE /compute/v2.1/servers/8fd2f208-dd3d-4ea2-b97f-5c70404be701 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 05:09:55.388818 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-7aff5184-a999-43e8-ba0a-b2d27773dbfa tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:09:55.389550 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-7aff5184-a999-43e8-ba0a-b2d27773dbfa tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] [instance: 8fd2f208-dd3d-4ea2-b97f-5c70404be701] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:09:55.398283 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7aff5184-a999-43e8-ba0a-b2d27773dbfa tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:09:55.398752 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7aff5184-a999-43e8-ba0a-b2d27773dbfa tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:09:55.399510 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7aff5184-a999-43e8-ba0a-b2d27773dbfa tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:09:55.399945 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-7aff5184-a999-43e8-ba0a-b2d27773dbfa tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:09:55.413579 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.wsgi [None req-7aff5184-a999-43e8-ba0a-b2d27773dbfa tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] HTTP exception thrown: Instance 8fd2f208-dd3d-4ea2-b97f-5c70404be701 could not be found. Jul 30 05:09:55.415501 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-7aff5184-a999-43e8-ba0a-b2d27773dbfa tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Request method failure captured: Jul 30 05:09:55.415501 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: request: GET /compute/v2.1/servers/8fd2f208-dd3d-4ea2-b97f-5c70404be701 HTTP/1.1 Jul 30 05:09:55.415501 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Accept: application/json Jul 30 05:09:55.415501 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Accept-Encoding: identity Jul 30 05:09:55.415501 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Connection: close Jul 30 05:09:55.415501 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Content-Length: 0 Jul 30 05:09:55.415501 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Content-Type: application/json Jul 30 05:09:55.415501 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Host: 10.222.0.20 Jul 30 05:09:55.415501 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Openstack-System-Scope: None Jul 30 05:09:55.415501 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: User-Agent: python-urllib3/1.26.10 Jul 30 05:09:55.415501 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Auth-Token: gAAAAABi5Lwx6u3dW8NgrhXRDeFXnnP4lKZIRtv95bi5xMIG9sQWzxvNRse6IwUXHzfxnT7jfXw1pF1w6rwEHJ09LzDtMWM5u0sWuNEZ6hZdfnFHX8MrtI_AUV39i3jn62Xa0Oa4hMKssKbQMxnqU81KKd6CEuwP8myCBr3mKHN0Nm_CGgcZN90 Jul 30 05:09:55.415501 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Domain-Id: None Jul 30 05:09:55.415501 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Domain-Name: None Jul 30 05:09:55.415501 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Identity-Status: Confirmed Jul 30 05:09:55.415501 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Is-Admin-Project: True Jul 30 05:09:55.415501 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Project-Domain-Id: default Jul 30 05:09:55.415501 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Project-Domain-Name: Default Jul 30 05:09:55.415501 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Project-Id: d9f8c70dc5de488698a8ab775c618088 Jul 30 05:09:55.415501 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Project-Name: tempest-AttachVolumeTestJSON-1448876773 Jul 30 05:09:55.415501 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Role: member,reader Jul 30 05:09:55.415501 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Roles: member,reader Jul 30 05:09:55.417160 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d9f8c70dc5de488698a8ab775c618088"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d9f8c70dc5de488698a8ab775c618088"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d9f8c70dc5de488698a8ab775c618088"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d9f8c70dc5de488698a8ab775c618088"}]}] Jul 30 05:09:55.417160 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Tenant: tempest-AttachVolumeTestJSON-1448876773 Jul 30 05:09:55.417160 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Tenant-Id: d9f8c70dc5de488698a8ab775c618088 Jul 30 05:09:55.417160 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1448876773 Jul 30 05:09:55.417160 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User: tempest-AttachVolumeTestJSON-1448876773-project Jul 30 05:09:55.417160 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User-Domain-Id: default Jul 30 05:09:55.417160 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User-Domain-Name: Default Jul 30 05:09:55.417160 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User-Id: 3a805f5dec66484c8d950b6bc52e3e03 Jul 30 05:09:55.417160 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User-Name: tempest-AttachVolumeTestJSON-1448876773-project Jul 30 05:09:55.417160 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: method: > Jul 30 05:09:55.417160 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: exception: Instance 8fd2f208-dd3d-4ea2-b97f-5c70404be701 could not be found. Jul 30 05:09:55.417160 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: action_args: {'id': '8fd2f208-dd3d-4ea2-b97f-5c70404be701'} Jul 30 05:09:55.418077 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 05:09:55.418077 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:09:55.418077 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 05:09:55.418077 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 05:09:55.418077 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 05:09:55.418077 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 05:09:55.418077 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 05:09:55.418077 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 05:09:55.418077 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 05:09:55.418077 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 05:09:55.418077 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fd2f208-dd3d-4ea2-b97f-5c70404be701 could not be found. Jul 30 05:09:55.418077 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 05:09:55.418077 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 05:09:55.418077 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 05:09:55.418077 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:09:55.418077 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 05:09:55.418077 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 05:09:55.418077 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 05:09:55.418077 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 05:09:55.418077 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 05:09:55.419572 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 05:09:55.419572 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 05:09:55.419572 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 05:09:55.419572 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 05:09:55.419572 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 05:09:55.419572 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 05:09:55.419572 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 05:09:55.419572 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fd2f208-dd3d-4ea2-b97f-5c70404be701 could not be found. Jul 30 05:09:55.419572 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 05:09:55.419572 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 05:09:55.419572 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 05:09:55.419572 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:09:55.419572 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 05:09:55.419572 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 05:09:55.419572 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 05:09:55.419572 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 05:09:55.419572 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fd2f208-dd3d-4ea2-b97f-5c70404be701 could not be found. Jul 30 05:09:55.419572 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 05:09:55.420955 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-7aff5184-a999-43e8-ba0a-b2d27773dbfa tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Returning 404 to user: Instance 8fd2f208-dd3d-4ea2-b97f-5c70404be701 could not be found. {{(pid=117886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 05:09:55.420955 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-7aff5184-a999-43e8-ba0a-b2d27773dbfa tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] 10.222.0.20 "GET /compute/v2.1/servers/8fd2f208-dd3d-4ea2-b97f-5c70404be701" status: 404 len: 111 microversion: 2.1 time: 0.031973 Jul 30 05:09:55.420955 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 632/1218] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:09:55 2022] GET /compute/v2.1/servers/8fd2f208-dd3d-4ea2-b97f-5c70404be701 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 05:09:56.557253 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-8bdbb3bb-9569-484b-87f7-9a1519d24eeb tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Calling method '>' {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:09:56.557803 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.compute.api [None req-8bdbb3bb-9569-484b-87f7-9a1519d24eeb tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] [instance: fb65e17c-681e-4949-a673-03130f14c360] Fetching instance by UUID {{(pid=117885) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:09:56.564845 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8bdbb3bb-9569-484b-87f7-9a1519d24eeb tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:09:56.565291 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8bdbb3bb-9569-484b-87f7-9a1519d24eeb tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:09:56.566055 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8bdbb3bb-9569-484b-87f7-9a1519d24eeb tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:09:56.566525 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG oslo_concurrency.lockutils [None req-8bdbb3bb-9569-484b-87f7-9a1519d24eeb tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:09:56.580403 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.wsgi [None req-8bdbb3bb-9569-484b-87f7-9a1519d24eeb tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] HTTP exception thrown: Instance fb65e17c-681e-4949-a673-03130f14c360 could not be found. Jul 30 05:09:56.581919 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-8bdbb3bb-9569-484b-87f7-9a1519d24eeb tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Request method failure captured: Jul 30 05:09:56.581919 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: request: DELETE /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360 HTTP/1.1 Jul 30 05:09:56.581919 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Accept: application/json Jul 30 05:09:56.581919 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Accept-Encoding: identity Jul 30 05:09:56.581919 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Connection: close Jul 30 05:09:56.581919 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Content-Length: 0 Jul 30 05:09:56.581919 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Content-Type: application/json Jul 30 05:09:56.581919 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Host: 10.222.0.20 Jul 30 05:09:56.581919 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Openstack-System-Scope: None Jul 30 05:09:56.581919 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: User-Agent: python-urllib3/1.26.10 Jul 30 05:09:56.581919 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Auth-Token: gAAAAABi5Lwx6u3dW8NgrhXRDeFXnnP4lKZIRtv95bi5xMIG9sQWzxvNRse6IwUXHzfxnT7jfXw1pF1w6rwEHJ09LzDtMWM5u0sWuNEZ6hZdfnFHX8MrtI_AUV39i3jn62Xa0Oa4hMKssKbQMxnqU81KKd6CEuwP8myCBr3mKHN0Nm_CGgcZN90 Jul 30 05:09:56.581919 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Domain-Id: None Jul 30 05:09:56.581919 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Domain-Name: None Jul 30 05:09:56.581919 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Identity-Status: Confirmed Jul 30 05:09:56.581919 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Is-Admin-Project: True Jul 30 05:09:56.581919 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Domain-Id: default Jul 30 05:09:56.581919 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Domain-Name: Default Jul 30 05:09:56.581919 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Id: d9f8c70dc5de488698a8ab775c618088 Jul 30 05:09:56.581919 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Project-Name: tempest-AttachVolumeTestJSON-1448876773 Jul 30 05:09:56.581919 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Role: member,reader Jul 30 05:09:56.581919 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Roles: member,reader Jul 30 05:09:56.583563 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d9f8c70dc5de488698a8ab775c618088"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d9f8c70dc5de488698a8ab775c618088"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d9f8c70dc5de488698a8ab775c618088"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d9f8c70dc5de488698a8ab775c618088"}]}] Jul 30 05:09:56.583563 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Tenant: tempest-AttachVolumeTestJSON-1448876773 Jul 30 05:09:56.583563 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Tenant-Id: d9f8c70dc5de488698a8ab775c618088 Jul 30 05:09:56.583563 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1448876773 Jul 30 05:09:56.583563 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User: tempest-AttachVolumeTestJSON-1448876773-project Jul 30 05:09:56.583563 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Domain-Id: default Jul 30 05:09:56.583563 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Domain-Name: Default Jul 30 05:09:56.583563 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Id: 3a805f5dec66484c8d950b6bc52e3e03 Jul 30 05:09:56.583563 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: X-User-Name: tempest-AttachVolumeTestJSON-1448876773-project Jul 30 05:09:56.583563 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: method: > Jul 30 05:09:56.583563 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: exception: Instance fb65e17c-681e-4949-a673-03130f14c360 could not be found. Jul 30 05:09:56.583563 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: action_args: {'id': 'fb65e17c-681e-4949-a673-03130f14c360'} Jul 30 05:09:56.584471 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: {{(pid=117885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 05:09:56.584471 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:09:56.584471 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 05:09:56.584471 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 05:09:56.584471 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 05:09:56.584471 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 05:09:56.584471 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 05:09:56.584471 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 05:09:56.584471 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 05:09:56.584471 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 05:09:56.584471 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb65e17c-681e-4949-a673-03130f14c360 could not be found. Jul 30 05:09:56.584471 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:09:56.584471 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 05:09:56.584471 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:09:56.584471 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:09:56.584471 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 05:09:56.584471 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 05:09:56.584471 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 05:09:56.584471 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 05:09:56.584471 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 05:09:56.585976 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 05:09:56.585976 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 30 05:09:56.585976 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 30 05:09:56.585976 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 30 05:09:56.585976 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 30 05:09:56.585976 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 05:09:56.585976 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 05:09:56.585976 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 05:09:56.585976 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 05:09:56.585976 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb65e17c-681e-4949-a673-03130f14c360 could not be found. Jul 30 05:09:56.585976 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:09:56.585976 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 05:09:56.585976 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:09:56.585976 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:09:56.585976 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 05:09:56.585976 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 05:09:56.585976 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 05:09:56.585976 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 05:09:56.585976 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb65e17c-681e-4949-a673-03130f14c360 could not be found. Jul 30 05:09:56.585976 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: ERROR nova.api.openstack.wsgi Jul 30 05:09:56.587641 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: DEBUG nova.api.openstack.wsgi [None req-8bdbb3bb-9569-484b-87f7-9a1519d24eeb tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Returning 404 to user: Instance fb65e17c-681e-4949-a673-03130f14c360 could not be found. {{(pid=117885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 05:09:56.587641 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO nova.api.openstack.requestlog [None req-8bdbb3bb-9569-484b-87f7-9a1519d24eeb tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] 10.222.0.20 "DELETE /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360" status: 404 len: 111 microversion: 2.1 time: 0.029983 Jul 30 05:09:56.587641 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: [pid: 117885|app: 0|req: 587/1219] 10.222.0.20 () {58 vars in 1239 bytes} [Sat Jul 30 05:09:56 2022] DELETE /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 05:09:56.591477 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-928686e7-9ca6-4686-85ba-8b1d3efcd3df tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Calling method '>' {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 30 05:09:56.592089 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.compute.api [None req-928686e7-9ca6-4686-85ba-8b1d3efcd3df tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] [instance: fb65e17c-681e-4949-a673-03130f14c360] Fetching instance by UUID {{(pid=117886) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 30 05:09:56.599355 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-928686e7-9ca6-4686-85ba-8b1d3efcd3df tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:09:56.599800 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-928686e7-9ca6-4686-85ba-8b1d3efcd3df tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:09:56.600547 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-928686e7-9ca6-4686-85ba-8b1d3efcd3df tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 30 05:09:56.600979 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG oslo_concurrency.lockutils [None req-928686e7-9ca6-4686-85ba-8b1d3efcd3df tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Lock "25ab7be4-4766-4eb8-ab18-1f848f2f4df6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 30 05:09:56.613981 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.wsgi [None req-928686e7-9ca6-4686-85ba-8b1d3efcd3df tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] HTTP exception thrown: Instance fb65e17c-681e-4949-a673-03130f14c360 could not be found. Jul 30 05:09:56.615526 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-928686e7-9ca6-4686-85ba-8b1d3efcd3df tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Request method failure captured: Jul 30 05:09:56.615526 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: request: GET /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360 HTTP/1.1 Jul 30 05:09:56.615526 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Accept: application/json Jul 30 05:09:56.615526 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Accept-Encoding: identity Jul 30 05:09:56.615526 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Connection: close Jul 30 05:09:56.615526 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Content-Length: 0 Jul 30 05:09:56.615526 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Content-Type: application/json Jul 30 05:09:56.615526 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Host: 10.222.0.20 Jul 30 05:09:56.615526 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Openstack-System-Scope: None Jul 30 05:09:56.615526 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: User-Agent: python-urllib3/1.26.10 Jul 30 05:09:56.615526 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Auth-Token: gAAAAABi5Lwx6u3dW8NgrhXRDeFXnnP4lKZIRtv95bi5xMIG9sQWzxvNRse6IwUXHzfxnT7jfXw1pF1w6rwEHJ09LzDtMWM5u0sWuNEZ6hZdfnFHX8MrtI_AUV39i3jn62Xa0Oa4hMKssKbQMxnqU81KKd6CEuwP8myCBr3mKHN0Nm_CGgcZN90 Jul 30 05:09:56.615526 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Domain-Id: None Jul 30 05:09:56.615526 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Domain-Name: None Jul 30 05:09:56.615526 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Identity-Status: Confirmed Jul 30 05:09:56.615526 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Is-Admin-Project: True Jul 30 05:09:56.615526 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Project-Domain-Id: default Jul 30 05:09:56.615526 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Project-Domain-Name: Default Jul 30 05:09:56.615526 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Project-Id: d9f8c70dc5de488698a8ab775c618088 Jul 30 05:09:56.615526 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Project-Name: tempest-AttachVolumeTestJSON-1448876773 Jul 30 05:09:56.615526 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Role: member,reader Jul 30 05:09:56.615526 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Roles: member,reader Jul 30 05:09:56.617411 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d9f8c70dc5de488698a8ab775c618088"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d9f8c70dc5de488698a8ab775c618088"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d9f8c70dc5de488698a8ab775c618088"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d9f8c70dc5de488698a8ab775c618088"}]}] Jul 30 05:09:56.617411 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Tenant: tempest-AttachVolumeTestJSON-1448876773 Jul 30 05:09:56.617411 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Tenant-Id: d9f8c70dc5de488698a8ab775c618088 Jul 30 05:09:56.617411 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1448876773 Jul 30 05:09:56.617411 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User: tempest-AttachVolumeTestJSON-1448876773-project Jul 30 05:09:56.617411 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User-Domain-Id: default Jul 30 05:09:56.617411 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User-Domain-Name: Default Jul 30 05:09:56.617411 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User-Id: 3a805f5dec66484c8d950b6bc52e3e03 Jul 30 05:09:56.617411 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: X-User-Name: tempest-AttachVolumeTestJSON-1448876773-project Jul 30 05:09:56.617411 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: method: > Jul 30 05:09:56.617411 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: exception: Instance fb65e17c-681e-4949-a673-03130f14c360 could not be found. Jul 30 05:09:56.617411 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: action_args: {'id': 'fb65e17c-681e-4949-a673-03130f14c360'} Jul 30 05:09:56.618476 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: {{(pid=117886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 30 05:09:56.618476 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:09:56.618476 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 30 05:09:56.618476 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 30 05:09:56.618476 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 30 05:09:56.618476 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 30 05:09:56.618476 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 30 05:09:56.618476 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 30 05:09:56.618476 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 30 05:09:56.618476 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 30 05:09:56.618476 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb65e17c-681e-4949-a673-03130f14c360 could not be found. Jul 30 05:09:56.618476 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 05:09:56.618476 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 05:09:56.618476 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 05:09:56.618476 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:09:56.618476 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 05:09:56.618476 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 05:09:56.618476 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 30 05:09:56.618476 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 30 05:09:56.618476 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 30 05:09:56.620051 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 30 05:09:56.620051 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 30 05:09:56.620051 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 30 05:09:56.620051 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 30 05:09:56.620051 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 30 05:09:56.620051 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 30 05:09:56.620051 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 30 05:09:56.620051 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb65e17c-681e-4949-a673-03130f14c360 could not be found. Jul 30 05:09:56.620051 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 05:09:56.620051 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 30 05:09:56.620051 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 05:09:56.620051 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 30 05:09:56.620051 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 30 05:09:56.620051 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 30 05:09:56.620051 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 30 05:09:56.620051 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 30 05:09:56.620051 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb65e17c-681e-4949-a673-03130f14c360 could not be found. Jul 30 05:09:56.620051 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: ERROR nova.api.openstack.wsgi Jul 30 05:09:56.621447 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: DEBUG nova.api.openstack.wsgi [None req-928686e7-9ca6-4686-85ba-8b1d3efcd3df tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] Returning 404 to user: Instance fb65e17c-681e-4949-a673-03130f14c360 could not be found. {{(pid=117886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 30 05:09:56.621447 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO nova.api.openstack.requestlog [None req-928686e7-9ca6-4686-85ba-8b1d3efcd3df tempest-AttachVolumeTestJSON-1448876773 tempest-AttachVolumeTestJSON-1448876773-project] 10.222.0.20 "GET /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360" status: 404 len: 111 microversion: 2.1 time: 0.029157 Jul 30 05:09:56.621447 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: [pid: 117886|app: 0|req: 633/1220] 10.222.0.20 () {58 vars in 1236 bytes} [Sat Jul 30 05:09:56 2022] GET /compute/v2.1/servers/fb65e17c-681e-4949-a673-03130f14c360 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 30 05:11:42.026424 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 30 05:11:42.026936 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Sat Jul 30 05:11:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 30 05:11:46.084130 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 30 05:11:46.084670 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Sat Jul 30 05:11:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 30 05:11:47.266707 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 30 05:11:47.267238 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Sat Jul 30 05:11:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 30 05:12:10.406667 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 30 05:12:10.407416 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Sat Jul 30 05:12:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 30 05:15:01.722622 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 30 05:15:01.723241 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Sat Jul 30 05:15:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 30 05:15:02.034528 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 30 05:15:02.035002 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Sat Jul 30 05:15:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 30 05:15:06.092603 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 30 05:15:06.093033 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Sat Jul 30 05:15:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 30 05:15:07.274795 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 30 05:15:07.275231 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Sat Jul 30 05:15:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 30 05:15:28.237577 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 30 05:15:28.238172 dv-cinder-851279-3-iscsi devstack@n-api.service[117886]: Sat Jul 30 05:15:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 30 05:15:30.414608 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 30 05:15:30.415188 dv-cinder-851279-3-iscsi devstack@n-api.service[117885]: Sat Jul 30 05:15:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!